CoolFace
Modelpublic

RichardErkhov/Eurdem_-_megatron_1.1_MoE_2x7B-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes197downloads
filemegatron_1.1_MoE_2x7B.IQ3_M.gguf5.35 GBdownload
filemegatron_1.1_MoE_2x7B.IQ3_S.gguf5.22 GBdownload
filemegatron_1.1_MoE_2x7B.IQ3_XS.gguf4.95 GBdownload
filemegatron_1.1_MoE_2x7B.IQ4_NL.gguf6.85 GBdownload
filemegatron_1.1_MoE_2x7B.IQ4_XS.gguf6.50 GBdownload
filemegatron_1.1_MoE_2x7B.Q2_K.gguf4.43 GBdownload
filemegatron_1.1_MoE_2x7B.Q3_K_L.gguf6.27 GBdownload
filemegatron_1.1_MoE_2x7B.Q3_K_M.gguf5.78 GBdownload
filemegatron_1.1_MoE_2x7B.Q3_K_S.gguf5.20 GBdownload
filemegatron_1.1_MoE_2x7B.Q3_K.gguf5.78 GBdownload
filemegatron_1.1_MoE_2x7B.Q4_0.gguf6.78 GBdownload
filemegatron_1.1_MoE_2x7B.Q4_1.gguf7.52 GBdownload
filemegatron_1.1_MoE_2x7B.Q4_K_M.gguf7.25 GBdownload
filemegatron_1.1_MoE_2x7B.Q4_K_S.gguf6.84 GBdownload
filemegatron_1.1_MoE_2x7B.Q4_K.gguf7.25 GBdownload
filemegatron_1.1_MoE_2x7B.Q5_0.gguf8.26 GBdownload
filemegatron_1.1_MoE_2x7B.Q5_1.gguf9.01 GBdownload
filemegatron_1.1_MoE_2x7B.Q5_K_M.gguf8.51 GBdownload
filemegatron_1.1_MoE_2x7B.Q5_K_S.gguf8.26 GBdownload
filemegatron_1.1_MoE_2x7B.Q5_K.gguf8.51 GBdownload
filemegatron_1.1_MoE_2x7B.Q6_K.gguf9.84 GBdownload
filemegatron_1.1_MoE_2x7B.Q8_0.gguf12.75 GBdownload

RichardErkhov/Eurdem_-_megatron_1.1_MoE_2x7B-gguf · main · files are served by the source, never re-hosted here