Modelpublic

mradermacher/EastAsia-4x7B-Moe-experiment-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

0likes146downloads

fileEastAsia-4x7B-Moe-experiment.IQ4_XS.gguf9.32 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q2_K.gguf6.33 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q3_K_L.gguf8.98 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q3_K_M.gguf8.28 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q3_K_S.gguf7.46 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q4_K_M.gguf10.43 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q4_K_S.gguf9.82 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q5_K_M.gguf12.23 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q5_K_S.gguf11.87 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q6_K.gguf14.15 GBdownload

fileEastAsia-4x7B-Moe-experiment.Q8_0.gguf18.33 GBdownload

mradermacher/EastAsia-4x7B-Moe-experiment-GGUF · main · files are served by the source, never re-hosted here