Modelpublic

mradermacher/Llama-3-MoE-v1-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes601downloads

fileLlama-3-MoE-v1.IQ3_M.gguf8.10 GBdownload

fileLlama-3-MoE-v1.IQ3_S.gguf7.94 GBdownload

fileLlama-3-MoE-v1.IQ3_XS.gguf7.54 GBdownload

fileLlama-3-MoE-v1.IQ4_XS.gguf9.82 GBdownload

fileLlama-3-MoE-v1.Q2_K.gguf6.76 GBdownload

fileLlama-3-MoE-v1.Q3_K_L.gguf9.44 GBdownload

fileLlama-3-MoE-v1.Q3_K_M.gguf8.75 GBdownload

fileLlama-3-MoE-v1.Q3_K_S.gguf7.93 GBdownload

fileLlama-3-MoE-v1.Q4_K_M.gguf10.94 GBdownload

fileLlama-3-MoE-v1.Q4_K_S.gguf10.33 GBdownload

fileLlama-3-MoE-v1.Q5_K_M.gguf12.79 GBdownload

fileLlama-3-MoE-v1.Q5_K_S.gguf12.43 GBdownload

fileLlama-3-MoE-v1.Q6_K.gguf14.76 GBdownload

fileLlama-3-MoE-v1.Q8_0.gguf19.11 GBdownload

mradermacher/Llama-3-MoE-v1-GGUF · main · files are served by the source, never re-hosted here