CoolFace
Modelpublic

mradermacher/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes101downloads
root
file.gitattributes3 KBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.IQ4_XS.gguf17.79 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q2_K.gguf12.04 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q3_K_L.gguf17.10 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q3_K_M.gguf15.79 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q3_K_S.gguf14.23 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q4_K_M.gguf19.96 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q4_K_S.gguf18.76 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q5_K_M.gguf23.41 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q5_K_S.gguf22.70 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q6_K.gguf27.07 GBdownload
fileMixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts.Q8_0.gguf35.06 GBdownload
fileREADME.md4 KBdownload

mradermacher/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts-GGUF · main · files are served by the source, never re-hosted here