Modelpublic

NANI-Nithin/Instella-MoE-16B-A3B-Think-GGUF

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face

2likes6.2kdownloads

fileInstella-MoE-16B-A3B-Think-BF16.gguf29.56 GBdownload

fileInstella-MoE-16B-A3B-Think-IQ2_M.gguf5.97 GBdownload

fileInstella-MoE-16B-A3B-Think-IQ3_M.gguf7.12 GBdownload

fileInstella-MoE-16B-A3B-Think-IQ3_XS.gguf6.72 GBdownload

fileInstella-MoE-16B-A3B-Think-IQ3_XXS.gguf6.57 GBdownload

fileInstella-MoE-16B-A3B-Think-IQ4_NL.gguf8.39 GBdownload

fileInstella-MoE-16B-A3B-Think-IQ4_XS.gguf8.08 GBdownload

fileInstella-MoE-16B-A3B-Think-Q2_K.gguf6.07 GBdownload

fileInstella-MoE-16B-A3B-Think-Q3_K_L.gguf7.96 GBdownload

fileInstella-MoE-16B-A3B-Think-Q3_K_M.gguf7.65 GBdownload

fileInstella-MoE-16B-A3B-Think-Q3_K_S.gguf7.06 GBdownload

fileInstella-MoE-16B-A3B-Think-Q4_0.gguf8.39 GBdownload

fileInstella-MoE-16B-A3B-Think-Q4_1.gguf9.30 GBdownload

fileInstella-MoE-16B-A3B-Think-Q4_K_M.gguf9.75 GBdownload

fileInstella-MoE-16B-A3B-Think-Q4_K_S.gguf8.98 GBdownload

fileInstella-MoE-16B-A3B-Think-Q5_K_M.gguf11.15 GBdownload

fileInstella-MoE-16B-A3B-Think-Q5_K_S.gguf10.49 GBdownload

fileInstella-MoE-16B-A3B-Think-Q6_K.gguf13.23 GBdownload

fileInstella-MoE-16B-A3B-Think-Q8_0.gguf15.71 GBdownload

NANI-Nithin/Instella-MoE-16B-A3B-Think-GGUF · main · files are served by the source, never re-hosted here