CoolFace
Modelpublic

mradermacher/Slim-Llama3.1-405B-i1-GGUF

sourceHugging Faceupdated 10mo agoView on Hugging Face
0likes711downloads
root
file.gitattributes3 KBdownload
fileREADME.md6 KBdownload
fileSlim-Llama3.1-405B.i1-IQ1_M.gguf16.13 GBdownload
fileSlim-Llama3.1-405B.i1-IQ1_S.gguf14.84 GBdownload
fileSlim-Llama3.1-405B.i1-IQ2_M.gguf23.00 GBdownload
fileSlim-Llama3.1-405B.i1-IQ2_S.gguf21.27 GBdownload
fileSlim-Llama3.1-405B.i1-IQ2_XS.gguf20.17 GBdownload
fileSlim-Llama3.1-405B.i1-IQ2_XXS.gguf18.28 GBdownload
fileSlim-Llama3.1-405B.i1-IQ3_M.gguf30.20 GBdownload
fileSlim-Llama3.1-405B.i1-IQ3_S.gguf29.29 GBdownload
fileSlim-Llama3.1-405B.i1-IQ3_XS.gguf27.81 GBdownload
fileSlim-Llama3.1-405B.i1-IQ3_XXS.gguf26.02 GBdownload
fileSlim-Llama3.1-405B.i1-IQ4_XS.gguf35.83 GBdownload
fileSlim-Llama3.1-405B.i1-Q2_K_S.gguf23.17 GBdownload
fileSlim-Llama3.1-405B.i1-Q2_K.gguf25.06 GBdownload
fileSlim-Llama3.1-405B.i1-Q3_K_L.gguf35.08 GBdownload
fileSlim-Llama3.1-405B.i1-Q3_K_M.gguf32.36 GBdownload
fileSlim-Llama3.1-405B.i1-Q3_K_S.gguf29.24 GBdownload
fileSlim-Llama3.1-405B.i1-Q4_0.gguf37.89 GBdownload
fileSlim-Llama3.1-405B.i1-Q4_1.gguf41.80 GBdownload
fileSlim-Llama3.1-405B.i1-Q4_K_M.gguf39.92 GBdownload
fileSlim-Llama3.1-405B.i1-Q4_K_S.gguf38.00 GBdownload
fileSlim-Llama3.1-405B.i1-Q5_K_M.gguf46.92 GBdownload
fileSlim-Llama3.1-405B.i1-Q5_K_S.gguf45.82 GBdownload
fileSlim-Llama3.1-405B.i1-Q6_K.gguf54.36 GBdownload
fileSlim-Llama3.1-405B.imatrix.gguf12.2 MBdownload

mradermacher/Slim-Llama3.1-405B-i1-GGUF · main · files are served by the source, never re-hosted here