CoolFace
Modelpublic

unsloth/Llama-3.2-3B-Instruct-GGUF

sourceHugging Facellama3.2updated 11mo agoView on Hugging Face
83likes183kdownloads
root
file.gitattributes3 KBdownload
fileconfig.json895 Bdownload
fileimatrix_unsloth.dat2.8 MBdownload
fileLlama-3.2-3B-Instruct-BF16.gguf5.99 GBdownload
fileLlama-3.2-3B-Instruct-F16.gguf5.99 GBdownload
fileLlama-3.2-3B-Instruct-IQ4_NL.gguf1.79 GBdownload
fileLlama-3.2-3B-Instruct-IQ4_XS.gguf1.70 GBdownload
fileLlama-3.2-3B-Instruct-Q2_K_L.gguf1.27 GBdownload
fileLlama-3.2-3B-Instruct-Q2_K.gguf1.27 GBdownload
fileLlama-3.2-3B-Instruct-Q3_K_M.gguf1.57 GBdownload
fileLlama-3.2-3B-Instruct-Q3_K_S.gguf1.44 GBdownload
fileLlama-3.2-3B-Instruct-Q4_0.gguf1.79 GBdownload
fileLlama-3.2-3B-Instruct-Q4_1.gguf1.95 GBdownload
fileLlama-3.2-3B-Instruct-Q4_K_M.gguf1.88 GBdownload
fileLlama-3.2-3B-Instruct-Q4_K_S.gguf1.80 GBdownload
fileLlama-3.2-3B-Instruct-Q5_K_M.gguf2.16 GBdownload
fileLlama-3.2-3B-Instruct-Q5_K_S.gguf2.11 GBdownload
fileLlama-3.2-3B-Instruct-Q6_K.gguf2.46 GBdownload
fileLlama-3.2-3B-Instruct-Q8_0.gguf3.19 GBdownload
fileLlama-3.2-3B-Instruct-UD-IQ1_M.gguf915.9 MBdownload
fileLlama-3.2-3B-Instruct-UD-IQ1_S.gguf870.1 MBdownload
fileLlama-3.2-3B-Instruct-UD-IQ2_M.gguf1.17 GBdownload
fileLlama-3.2-3B-Instruct-UD-IQ2_XXS.gguf998.1 MBdownload
fileLlama-3.2-3B-Instruct-UD-IQ3_XXS.gguf1.28 GBdownload
fileLlama-3.2-3B-Instruct-UD-Q2_K_XL.gguf1.31 GBdownload
fileLlama-3.2-3B-Instruct-UD-Q3_K_XL.gguf1.62 GBdownload
fileLlama-3.2-3B-Instruct-UD-Q4_K_XL.gguf1.92 GBdownload
fileLlama-3.2-3B-Instruct-UD-Q5_K_XL.gguf2.17 GBdownload
fileLlama-3.2-3B-Instruct-UD-Q6_K_XL.gguf2.76 GBdownload
fileLlama-3.2-3B-Instruct-UD-Q8_K_XL.gguf3.92 GBdownload
fileREADME.md6 KBdownload

unsloth/Llama-3.2-3B-Instruct-GGUF · main · files are served by the source, never re-hosted here