CoolFace
Modelpublic

featherless-ai-quants/wang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes243downloads
root
file.gitattributes3 KBdownload
filefeatherless-quants.png1.5 MBdownload
fileREADME.md4 KBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-IQ4_XS.gguf3.67 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q2_K.gguf2.53 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q3_K_L.gguf3.56 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q3_K_M.gguf3.28 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q3_K_S.gguf2.95 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q4_K_M.gguf4.07 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q4_K_S.gguf3.86 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q5_K_M.gguf4.78 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q5_K_S.gguf4.65 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q6_K.gguf5.53 GBdownload
filewang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-Q8_0.gguf7.17 GBdownload

featherless-ai-quants/wang7776-Mistral-7B-Instruct-v0.2-sparsity-30-v0.1-GGUF · main · files are served by the source, never re-hosted here