CoolFace
Modelpublic

mradermacher/WizardLM-2-4x7B-MoE-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
2likes2.4kdownloads
root
file.gitattributes2 KBdownload
fileREADME.md4 KBdownload
fileWizardLM-2-4x7B-MoE.IQ3_M.gguf9.92 GBdownload
fileWizardLM-2-4x7B-MoE.IQ3_S.gguf9.73 GBdownload
fileWizardLM-2-4x7B-MoE.IQ3_XS.gguf9.21 GBdownload
fileWizardLM-2-4x7B-MoE.IQ4_XS.gguf12.14 GBdownload
fileWizardLM-2-4x7B-MoE.Q2_K.gguf8.23 GBdownload
fileWizardLM-2-4x7B-MoE.Q3_K_L.gguf11.68 GBdownload
fileWizardLM-2-4x7B-MoE.Q3_K_M.gguf10.78 GBdownload
fileWizardLM-2-4x7B-MoE.Q3_K_S.gguf9.72 GBdownload
fileWizardLM-2-4x7B-MoE.Q4_K_M.gguf13.61 GBdownload
fileWizardLM-2-4x7B-MoE.Q4_K_S.gguf12.80 GBdownload
fileWizardLM-2-4x7B-MoE.Q5_K_M.gguf15.96 GBdownload
fileWizardLM-2-4x7B-MoE.Q5_K_S.gguf15.48 GBdownload
fileWizardLM-2-4x7B-MoE.Q6_K.gguf18.45 GBdownload
fileWizardLM-2-4x7B-MoE.Q8_0.gguf23.90 GBdownload

mradermacher/WizardLM-2-4x7B-MoE-GGUF · main · files are served by the source, never re-hosted here