Modelpublic

featherless-ai-quants/wang7776-Mistral-7B-Instruct-v0.2-sparsity-10-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes348downloads

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-IQ4_XS.gguf3.67 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q2_K.gguf2.53 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q3_K_L.gguf3.56 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q3_K_M.gguf3.28 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q3_K_S.gguf2.95 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q4_K_M.gguf4.07 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q4_K_S.gguf3.86 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q5_K_M.gguf4.78 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q5_K_S.gguf4.65 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q6_K.gguf5.53 GBdownload

filewang7776-Mistral-7B-Instruct-v0.2-sparsity-10-Q8_0.gguf7.17 GBdownload

featherless-ai-quants/wang7776-Mistral-7B-Instruct-v0.2-sparsity-10-GGUF · main · files are served by the source, never re-hosted here