Modelpublic

bartowski/Phi-3.5-MoE-instruct-GGUF

sourceHugging Facemitupdated 2y agoView on Hugging Face

15likes10kdownloads

filePhi-3.5-MoE-instruct-IQ2_M.gguf12.82 GBdownload

filePhi-3.5-MoE-instruct-IQ2_S.gguf11.67 GBdownload

filePhi-3.5-MoE-instruct-IQ2_XS.gguf11.43 GBdownload

filePhi-3.5-MoE-instruct-IQ2_XXS.gguf10.27 GBdownload

filePhi-3.5-MoE-instruct-IQ3_M.gguf17.11 GBdownload

filePhi-3.5-MoE-instruct-IQ3_XS.gguf15.92 GBdownload

filePhi-3.5-MoE-instruct-IQ4_NL.gguf21.99 GBdownload

filePhi-3.5-MoE-instruct-IQ4_XS.gguf20.78 GBdownload

filePhi-3.5-MoE-instruct-Q2_K_L.gguf14.34 GBdownload

filePhi-3.5-MoE-instruct-Q2_K.gguf14.22 GBdownload

filePhi-3.5-MoE-instruct-Q3_K_L.gguf20.20 GBdownload

filePhi-3.5-MoE-instruct-Q3_K_M.gguf18.66 GBdownload

filePhi-3.5-MoE-instruct-Q3_K_S.gguf16.82 GBdownload

filePhi-3.5-MoE-instruct-Q3_K_XL.gguf20.31 GBdownload

filePhi-3.5-MoE-instruct-Q4_0.gguf22.08 GBdownload

filePhi-3.5-MoE-instruct-Q4_1.gguf24.41 GBdownload

filePhi-3.5-MoE-instruct-Q4_K_L.gguf23.70 GBdownload

filePhi-3.5-MoE-instruct-Q4_K_M.gguf23.61 GBdownload

filePhi-3.5-MoE-instruct-Q4_K_S.gguf22.18 GBdownload

filePhi-3.5-MoE-instruct-Q5_K_L.gguf27.75 GBdownload

filePhi-3.5-MoE-instruct-Q5_K_M.gguf27.68 GBdownload

filePhi-3.5-MoE-instruct-Q5_K_S.gguf26.84 GBdownload

filePhi-3.5-MoE-instruct-Q6_K_L.gguf32.06 GBdownload

filePhi-3.5-MoE-instruct-Q6_K.gguf32.00 GBdownload

filePhi-3.5-MoE-instruct-Q8_0.gguf41.44 GBdownload

bartowski/Phi-3.5-MoE-instruct-GGUF · main · files are served by the source, never re-hosted here