Modelpublic

RichardErkhov/notadib_-_Mistral-7B-Instruct-v0.2-attention-sparsity-30-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes2.3kdownloads

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.IQ3_M.gguf3.06 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.IQ3_S.gguf2.96 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.IQ3_XS.gguf2.81 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.IQ4_NL.gguf3.87 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.IQ4_XS.gguf3.67 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q2_K.gguf2.53 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q3_K_L.gguf3.56 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q3_K_M.gguf3.28 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q3_K_S.gguf2.95 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q3_K.gguf3.28 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q4_0.gguf3.83 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q4_1.gguf4.24 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q4_K_M.gguf4.07 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q4_K_S.gguf3.86 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q4_K.gguf4.07 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q5_0.gguf4.65 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q5_1.gguf5.07 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q5_K_M.gguf4.78 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q5_K_S.gguf4.65 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q5_K.gguf4.78 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q6_K.gguf5.53 GBdownload

fileMistral-7B-Instruct-v0.2-attention-sparsity-30.Q8_0.gguf7.17 GBdownload

RichardErkhov/notadib_-_Mistral-7B-Instruct-v0.2-attention-sparsity-30-gguf · main · files are served by the source, never re-hosted here