Modelpublic

mradermacher/Mixtral-GQA-400m-v2-GGUF

sourceHugging Faceapache-2.0updated 9mo agoView on Hugging Face

0likes345downloads

fileMixtral-GQA-400m-v2.f16.gguf3.74 GBdownload

fileMixtral-GQA-400m-v2.IQ4_XS.gguf1.02 GBdownload

fileMixtral-GQA-400m-v2.Q2_K.gguf735.6 MBdownload

fileMixtral-GQA-400m-v2.Q3_K_L.gguf1003.7 MBdownload

fileMixtral-GQA-400m-v2.Q3_K_M.gguf937.9 MBdownload

fileMixtral-GQA-400m-v2.Q3_K_S.gguf861.4 MBdownload

fileMixtral-GQA-400m-v2.Q4_K_M.gguf1.12 GBdownload

fileMixtral-GQA-400m-v2.Q4_K_S.gguf1.08 GBdownload

fileMixtral-GQA-400m-v2.Q5_K_M.gguf1.32 GBdownload

fileMixtral-GQA-400m-v2.Q5_K_S.gguf1.30 GBdownload

fileMixtral-GQA-400m-v2.Q6_K.gguf1.54 GBdownload

fileMixtral-GQA-400m-v2.Q8_0.gguf1.99 GBdownload

mradermacher/Mixtral-GQA-400m-v2-GGUF · main · files are served by the source, never re-hosted here