CoolFace
Modelpublic

featherless-ai-quants/notadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes377downloads
root
file.gitattributes3 KBdownload
filefeatherless-quants.png1.5 MBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-IQ4_XS.gguf3.67 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q2_K.gguf2.53 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q3_K_L.gguf3.56 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q3_K_M.gguf3.28 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q3_K_S.gguf2.95 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q4_K_M.gguf4.07 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q4_K_S.gguf3.86 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q5_K_M.gguf4.78 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q5_K_S.gguf4.65 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q6_K.gguf5.53 GBdownload
filenotadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-Q8_0.gguf7.17 GBdownload
fileREADME.md4 KBdownload

featherless-ai-quants/notadib-Mistral-7B-Instruct-v0.2-attention-sparsity-10-v0.1-GGUF · main · files are served by the source, never re-hosted here