CoolFace
Modelpublic

mradermacher/Llama-3.1-8b-Pruned-1-Layer-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes1.2kdownloads
root
file.gitattributes3 KBdownload
fileLlama-3.1-8b-Pruned-1-Layer.f16.gguf14.15 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.IQ3_M.gguf3.34 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.IQ3_S.gguf3.25 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.IQ3_XS.gguf3.11 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.IQ4_XS.gguf3.95 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q2_K.gguf2.81 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q3_K_L.gguf3.81 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q3_K_M.gguf3.54 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q3_K_S.gguf3.24 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q4_K_M.gguf4.32 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q4_K_S.gguf4.13 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q5_K_M.gguf5.04 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q5_K_S.gguf4.94 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q6_K.gguf5.81 GBdownload
fileLlama-3.1-8b-Pruned-1-Layer.Q8_0.gguf7.52 GBdownload
fileREADME.md4 KBdownload

mradermacher/Llama-3.1-8b-Pruned-1-Layer-GGUF · main · files are served by the source, never re-hosted here