Modelpublic

mradermacher/EduMixtral-4x7B-GGUF

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face

0likes1.7kdownloads

fileEduMixtral-4x7B.IQ3_M.gguf9.92 GBdownload

fileEduMixtral-4x7B.IQ3_S.gguf9.73 GBdownload

fileEduMixtral-4x7B.IQ3_XS.gguf9.21 GBdownload

fileEduMixtral-4x7B.IQ4_XS.gguf12.15 GBdownload

fileEduMixtral-4x7B.Q2_K.gguf8.24 GBdownload

fileEduMixtral-4x7B.Q3_K_L.gguf11.68 GBdownload

fileEduMixtral-4x7B.Q3_K_M.gguf10.79 GBdownload

fileEduMixtral-4x7B.Q3_K_S.gguf9.72 GBdownload

fileEduMixtral-4x7B.Q4_K_M.gguf13.61 GBdownload

fileEduMixtral-4x7B.Q4_K_S.gguf12.80 GBdownload

fileEduMixtral-4x7B.Q5_K_M.gguf15.96 GBdownload

fileEduMixtral-4x7B.Q5_K_S.gguf15.48 GBdownload

fileEduMixtral-4x7B.Q6_K.gguf18.46 GBdownload

fileEduMixtral-4x7B.Q8_0.gguf23.90 GBdownload

mradermacher/EduMixtral-4x7B-GGUF · main · files are served by the source, never re-hosted here