CoolFace
Modelpublic

bartowski/PowerInfer_SmallThinker-4BA0.6B-Instruct-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes1.3kdownloads
root
file.gitattributes4 KBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-bf16.gguf7.96 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-imatrix.gguf16.0 MBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-IQ2_M.gguf1.38 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-IQ3_M.gguf1.91 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-IQ3_XS.gguf1.75 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-IQ3_XXS.gguf1.66 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-IQ4_NL.gguf2.32 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-IQ4_XS.gguf2.20 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q2_K_L.gguf1.73 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q2_K.gguf1.52 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_L.gguf1.96 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_M.gguf1.91 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_S.gguf1.83 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_XL.gguf2.15 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_0.gguf2.34 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_1.gguf2.54 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_K_L.gguf2.63 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_K_M.gguf2.46 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_K_S.gguf2.39 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q5_K_L.gguf2.99 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q5_K_M.gguf2.85 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q5_K_S.gguf2.78 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q6_K_L.gguf3.38 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q6_K.gguf3.27 GBdownload
filePowerInfer_SmallThinker-4BA0.6B-Instruct-Q8_0.gguf4.23 GBdownload
fileREADME.md14 KBdownload

bartowski/PowerInfer_SmallThinker-4BA0.6B-Instruct-GGUF · main · files are served by the source, never re-hosted here