CoolFace
Modelpublic

mradermacher/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes107downloads
root
file.gitattributes3 KBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.IQ4_XS.gguf14.97 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q2_K.gguf10.14 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q3_K_L.gguf14.39 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q3_K_M.gguf13.29 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q3_K_S.gguf11.97 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q4_K_M.gguf16.79 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q4_K_S.gguf15.78 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q5_K_M.gguf19.68 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q5_K_S.gguf19.09 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q6_K.gguf22.76 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts.Q8_0.gguf29.48 GBdownload
fileREADME.md4 KBdownload

mradermacher/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts-GGUF · main · files are served by the source, never re-hosted here