Modelpublic

duyntnet/SlimHercules-4.0-Mistral-7B-v0.2-imatrix-GGUF

sourceHugging Faceotherupdated 2y agoView on Hugging Face

0likes2.1kdownloads

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ1_M.gguf1.63 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ1_S.gguf1.50 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ2_M.gguf2.33 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ2_S.gguf2.15 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ2_XS.gguf2.05 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ2_XXS.gguf1.85 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ3_M.gguf3.06 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ3_S.gguf2.96 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ3_XS.gguf2.81 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ3_XXS.gguf2.63 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ4_NL.gguf3.84 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-IQ4_XS.gguf3.64 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q2_K_S.gguf2.36 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q2_K.gguf2.53 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q3_K_L.gguf3.56 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q3_K_M.gguf3.28 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q3_K_S.gguf2.95 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q4_0.gguf3.84 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q4_1.gguf4.24 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q4_K_M.gguf4.07 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q4_K_S.gguf3.86 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q5_0.gguf4.67 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q5_1.gguf5.07 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q5_K_M.gguf4.78 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q5_K_S.gguf4.65 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q6_K.gguf5.53 GBdownload

fileSlimHercules-4.0-Mistral-7B-v0.2-Q8_0.gguf7.17 GBdownload

duyntnet/SlimHercules-4.0-Mistral-7B-v0.2-imatrix-GGUF · main · files are served by the source, never re-hosted here