CoolFace
Modelpublic

mradermacher/SmallThinker-21BA3B-Instruct-i1-GGUF

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face
0likes1.1kdownloads
root
file.gitattributes3 KBdownload
fileREADME.md6 KBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ1_M.gguf4.74 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ1_S.gguf4.32 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ2_M.gguf6.76 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ2_S.gguf6.20 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ2_XS.gguf6.03 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ2_XXS.gguf5.45 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ3_M.gguf8.94 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ3_S.gguf8.79 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ3_XS.gguf8.34 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ3_XXS.gguf7.83 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-IQ4_XS.gguf10.79 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q2_K_S.gguf6.97 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q2_K.gguf7.46 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q3_K_L.gguf10.48 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q3_K_M.gguf9.70 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q3_K_S.gguf8.78 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q4_0.gguf11.44 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q4_1.gguf12.62 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q4_K_M.gguf12.19 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q4_K_S.gguf11.48 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q5_K_M.gguf14.26 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q5_K_S.gguf13.85 GBdownload
fileSmallThinker-21BA3B-Instruct.i1-Q6_K.gguf16.46 GBdownload
fileSmallThinker-21BA3B-Instruct.imatrix.gguf77.6 MBdownload

mradermacher/SmallThinker-21BA3B-Instruct-i1-GGUF · main · files are served by the source, never re-hosted here