CoolFace
Modelpublic

mradermacher/Mistral-Small-3.2-24B-Instruct-2506-llamacppfixed-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes425downloads
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.IQ4_XS.gguf12.00 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.mmproj-f16.gguf837.4 MBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.mmproj-Q8_0.gguf445.5 MBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q2_K.gguf8.28 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q3_K_L.gguf11.55 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q3_K_M.gguf10.69 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q3_K_S.gguf9.69 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q4_K_M.gguf13.35 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q4_K_S.gguf12.62 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q5_K_M.gguf15.61 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q5_K_S.gguf15.18 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q6_K.gguf18.02 GBdownload
fileMistral-Small-3.2-24B-Instruct-2506-llamacppfixed.Q8_0.gguf23.33 GBdownload

mradermacher/Mistral-Small-3.2-24B-Instruct-2506-llamacppfixed-GGUF · main · files are served by the source, never re-hosted here