Modelpublic

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

147likes162kdownloads

fileMistral-7B-Instruct-v0.3.fp16.gguf13.50 GBdownload

fileMistral-7B-Instruct-v0.3.IQ1_M.gguf1.64 GBdownload

fileMistral-7B-Instruct-v0.3.IQ1_S.gguf1.50 GBdownload

fileMistral-7B-Instruct-v0.3.IQ2_XS.gguf2.05 GBdownload

fileMistral-7B-Instruct-v0.3.IQ3_XS.gguf2.82 GBdownload

fileMistral-7B-Instruct-v0.3.IQ4_XS.gguf3.64 GBdownload

fileMistral-7B-Instruct-v0.3.Q2_K.gguf2.54 GBdownload

fileMistral-7B-Instruct-v0.3.Q3_K_L.gguf3.56 GBdownload

fileMistral-7B-Instruct-v0.3.Q3_K_M.gguf3.28 GBdownload

fileMistral-7B-Instruct-v0.3.Q3_K_S.gguf2.95 GBdownload

fileMistral-7B-Instruct-v0.3.Q4_K_M.gguf4.07 GBdownload

fileMistral-7B-Instruct-v0.3.Q4_K_S.gguf3.86 GBdownload

fileMistral-7B-Instruct-v0.3.Q5_K_M.gguf4.78 GBdownload

fileMistral-7B-Instruct-v0.3.Q5_K_S.gguf4.66 GBdownload

fileMistral-7B-Instruct-v0.3.Q6_K.gguf5.54 GBdownload

fileMistral-7B-Instruct-v0.3.Q8_0.gguf7.17 GBdownload

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF · main · files are served by the source, never re-hosted here