CoolFace
Modelpublic

mradermacher/Meta-Llama-3-2B-mlp-layer-pruned-i1-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes233downloads
root
file.gitattributes3 KBdownload
fileimatrix.dat1.8 MBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ1_M.gguf860.3 MBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ1_S.gguf835.6 MBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ2_M.gguf1.04 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ2_S.gguf1.01 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ2_XS.gguf942.6 MBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ2_XXS.gguf901.6 MBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ3_M.gguf1.26 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ3_S.gguf1.22 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ3_XS.gguf1.19 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ3_XXS.gguf1.08 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ4_NL.gguf1.47 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-IQ4_XS.gguf1.41 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q2_K_S.gguf1.04 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q2_K.gguf1.09 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q3_K_L.gguf1.36 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q3_K_M.gguf1.29 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q3_K_S.gguf1.21 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q4_0.gguf1.46 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q4_1.gguf1.57 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q4_K_M.gguf1.50 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q4_K_S.gguf1.46 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q5_K_M.gguf1.71 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q5_K_S.gguf1.69 GBdownload
fileMeta-Llama-3-2B-mlp-layer-pruned.i1-Q6_K.gguf1.94 GBdownload
fileREADME.md6 KBdownload

mradermacher/Meta-Llama-3-2B-mlp-layer-pruned-i1-GGUF · main · files are served by the source, never re-hosted here