CoolFace
Modelpublic

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
96likes18kdownloads
root
file.gitattributes4 KBdownload
fileconfig.json1 KBdownload
fileimatrix_unsloth.dat9.5 MBdownload
fileMistral-Small-3.1-24B-Instruct-2503-BF16.gguf43.92 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-IQ4_NL.gguf12.54 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-IQ4_XS.gguf11.90 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q2_K_L.gguf8.43 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q2_K.gguf8.28 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q3_K_M.gguf10.69 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q3_K_S.gguf9.69 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q4_0.gguf12.57 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q4_1.gguf13.85 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf13.35 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q4_K_S.gguf12.62 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q5_K_M.gguf15.61 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q5_K_S.gguf15.18 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q6_K.gguf18.02 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-Q8_0.gguf23.33 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-IQ1_M.gguf5.60 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-IQ1_S.gguf5.18 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf7.68 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-IQ2_XXS.gguf6.29 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-IQ3_XXS.gguf8.76 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-Q2_K_XL.gguf8.65 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-Q3_K_XL.gguf11.04 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-Q4_K_XL.gguf13.51 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-Q5_K_XL.gguf15.61 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-Q6_K_XL.gguf19.36 GBdownload
fileMistral-Small-3.1-24B-Instruct-2503-UD-Q8_K_XL.gguf27.00 GBdownload
filemmproj-BF16.gguf837.4 MBdownload
filemmproj-F16.gguf837.4 MBdownload
filemmproj-F32.gguf1.64 GBdownload
fileREADME.md20 KBdownload

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF · main · files are served by the source, never re-hosted here