CoolFace
Modelpublic

mradermacher/Llama3-8B-Structural-Pruning-1.5-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes88downloads
root
file.gitattributes2 KBdownload
fileLlama3-8B-Structural-Pruning-1.5.f16.gguf14.97 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.IQ4_XS.gguf4.18 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q2_K.gguf2.96 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q3_K_L.gguf4.03 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q3_K_M.gguf3.74 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q3_K_S.gguf3.41 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q4_K_M.gguf4.58 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q4_K_S.gguf4.37 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q5_K_M.gguf5.34 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q5_K_S.gguf5.21 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q6_K.gguf6.14 GBdownload
fileLlama3-8B-Structural-Pruning-1.5.Q8_0.gguf7.95 GBdownload
fileREADME.md4 KBdownload

mradermacher/Llama3-8B-Structural-Pruning-1.5-GGUF · main · files are served by the source, never re-hosted here