CoolFace
Modelpublic

mradermacher/DeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B-i1-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes1.3kdownloads
root
file.gitattributes4 KBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ1_M.gguf4.21 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ1_S.gguf3.84 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ2_M.gguf5.87 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ2_S.gguf5.38 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ2_XS.gguf5.29 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ2_XXS.gguf4.81 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ3_M.gguf8.03 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ3_S.gguf7.69 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ3_XS.gguf7.31 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ3_XXS.gguf6.87 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ4_NL.gguf9.86 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-IQ4_XS.gguf9.35 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q2_K_S.gguf6.07 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q2_K.gguf6.56 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q3_K_L.gguf8.98 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q3_K_M.gguf8.41 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q3_K_S.gguf7.69 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q4_0.gguf9.86 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q4_1.gguf10.87 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q4_K_M.gguf10.54 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q4_K_S.gguf9.93 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q5_K_M.gguf12.25 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q5_K_S.gguf11.90 GBdownload
fileDeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B.i1-Q6_K.gguf14.11 GBdownload
fileREADME.md7 KBdownload

mradermacher/DeepThought-MOE-8X3B-R1-Llama-3.2-Reasoning-18B-i1-GGUF · main · files are served by the source, never re-hosted here