CoolFace
Modelpublic

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
15likes151kdownloads
fileLlama-3.2-3B-Instruct.fp16.gguf5.99 GBdownload
fileLlama-3.2-3B-Instruct.IQ1_M.gguf881.4 MBdownload
fileLlama-3.2-3B-Instruct.IQ1_S.gguf827.9 MBdownload
fileLlama-3.2-3B-Instruct.IQ2_XS.gguf1.02 GBdownload
fileLlama-3.2-3B-Instruct.IQ3_XS.gguf1.38 GBdownload
fileLlama-3.2-3B-Instruct.IQ4_XS.gguf1.70 GBdownload
fileLlama-3.2-3B-Instruct.Q2_K.gguf1.27 GBdownload
fileLlama-3.2-3B-Instruct.Q3_K_L.gguf1.69 GBdownload
fileLlama-3.2-3B-Instruct.Q3_K_M.gguf1.57 GBdownload
fileLlama-3.2-3B-Instruct.Q3_K_S.gguf1.44 GBdownload
fileLlama-3.2-3B-Instruct.Q4_K_M.gguf1.88 GBdownload
fileLlama-3.2-3B-Instruct.Q4_K_S.gguf1.80 GBdownload
fileLlama-3.2-3B-Instruct.Q5_K_M.gguf2.16 GBdownload
fileLlama-3.2-3B-Instruct.Q5_K_S.gguf2.11 GBdownload
fileLlama-3.2-3B-Instruct.Q6_K.gguf2.46 GBdownload
fileLlama-3.2-3B-Instruct.Q8_0.gguf3.19 GBdownload

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF · main · files are served by the source, never re-hosted here