Modelpublic

mradermacher/MixtureofMerges-MoE-2x7b-v6-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

0likes238downloads

fileMixtureofMerges-MoE-2x7b-v6.IQ4_XS.gguf6.50 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q2_K.gguf4.43 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q3_K_L.gguf6.27 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q3_K_M.gguf5.78 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q3_K_S.gguf5.20 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q4_0_4_4.gguf6.78 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q4_K_M.gguf7.25 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q4_K_S.gguf6.84 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q5_K_M.gguf8.51 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q5_K_S.gguf8.26 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q6_K.gguf9.84 GBdownload

fileMixtureofMerges-MoE-2x7b-v6.Q8_0.gguf12.75 GBdownload

mradermacher/MixtureofMerges-MoE-2x7b-v6-GGUF · main · files are served by the source, never re-hosted here