CoolFace
Modelpublic

unsloth/Magistral-Small-2506-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
97likes2.8kdownloads
root
file.gitattributes3 KBdownload
fileMagistral-Small-2506-BF16.gguf43.92 GBdownload
fileMagistral-Small-2506-IQ4_NL.gguf12.54 GBdownload
fileMagistral-Small-2506-IQ4_XS.gguf11.90 GBdownload
fileMagistral-Small-2506-Q2_K_L.gguf8.43 GBdownload
fileMagistral-Small-2506-Q2_K.gguf8.28 GBdownload
fileMagistral-Small-2506-Q3_K_M.gguf10.69 GBdownload
fileMagistral-Small-2506-Q3_K_S.gguf9.69 GBdownload
fileMagistral-Small-2506-Q4_0.gguf12.57 GBdownload
fileMagistral-Small-2506-Q4_1.gguf13.85 GBdownload
fileMagistral-Small-2506-Q4_K_M.gguf13.35 GBdownload
fileMagistral-Small-2506-Q4_K_S.gguf12.62 GBdownload
fileMagistral-Small-2506-Q5_K_M.gguf15.61 GBdownload
fileMagistral-Small-2506-Q5_K_S.gguf15.18 GBdownload
fileMagistral-Small-2506-Q6_K.gguf18.02 GBdownload
fileMagistral-Small-2506-Q8_0.gguf23.33 GBdownload
fileMagistral-Small-2506-UD-IQ2_M.gguf7.68 GBdownload
fileMagistral-Small-2506-UD-IQ2_XXS.gguf6.29 GBdownload
fileMagistral-Small-2506-UD-IQ3_XXS.gguf8.76 GBdownload
fileMagistral-Small-2506-UD-Q2_K_XL.gguf8.65 GBdownload
fileMagistral-Small-2506-UD-Q3_K_XL.gguf11.04 GBdownload
fileMagistral-Small-2506-UD-Q4_K_XL.gguf13.51 GBdownload
fileMagistral-Small-2506-UD-Q5_K_XL.gguf15.61 GBdownload
fileMagistral-Small-2506-UD-Q6_K_XL.gguf19.36 GBdownload
fileMagistral-Small-2506-UD-Q8_K_XL.gguf27.00 GBdownload
filemmproj-BF16.gguf837.4 MBdownload
filemmproj-F16.gguf837.4 MBdownload
filemmproj-F32.gguf1.64 GBdownload
fileparams130 Bdownload
fileREADME.md9 KBdownload
filesystem819 Bdownload
filetemplate695 Bdownload

unsloth/Magistral-Small-2506-GGUF · main · files are served by the source, never re-hosted here