CoolFace
Modelpublic

mradermacher/Llama-3.2-1B-4B-Quad-MoE-GGUF

sourceHugging Facellama3.2updated 8mo agoView on Hugging Face
2likes398downloads
root
file.gitattributes2 KBdownload
fileLlama-3.2-1B-4B-Quad-MoE.f16.gguf6.81 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.IQ4_XS.gguf1.91 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q2_K.gguf1.36 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q3_K_L.gguf1.84 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q3_K_M.gguf1.72 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q3_K_S.gguf1.56 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q4_K_M.gguf2.12 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q4_K_S.gguf2.00 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q5_K_M.gguf2.45 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q5_K_S.gguf2.38 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q6_K.gguf2.80 GBdownload
fileLlama-3.2-1B-4B-Quad-MoE.Q8_0.gguf3.62 GBdownload
fileREADME.md4 KBdownload

mradermacher/Llama-3.2-1B-4B-Quad-MoE-GGUF · main · files are served by the source, never re-hosted here