Modelpublic

RichardErkhov/Na0s_-_Llama-3.1-8b-Pruned-4-Layers-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes5.4kdownloads

root

file.gitattributes3 KBdownload

fileLlama-3.1-8b-Pruned-4-Layers.IQ3_M.gguf3.07 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.IQ3_M.gguf3.07 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.IQ3_S.gguf2.99 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.IQ3_S.gguf2.99 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.IQ3_XS.gguf2.86 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.IQ3_XS.gguf2.86 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.IQ4_NL.gguf3.80 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.IQ4_NL.gguf3.80 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.IQ4_XS.gguf3.63 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.IQ4_XS.gguf3.63 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q2_K.gguf2.59 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q2_K.gguf2.59 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q3_K_L.gguf3.49 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q3_K_L.gguf3.49 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q3_K_M.gguf3.25 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q3_K_M.gguf3.25 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q3_K_S.gguf2.98 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q3_K_S.gguf2.98 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q3_K.gguf3.25 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q3_K.gguf3.25 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q4_0.gguf3.77 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q4_0.gguf1.70 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q4_1.gguf4.14 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q4_1.gguf4.14 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q4_K_M.gguf3.97 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q4_K_M.gguf3.97 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q4_K_S.gguf3.79 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q4_K_S.gguf3.79 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q4_K.gguf3.97 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q4_K.gguf3.97 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q5_0.gguf4.52 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q5_0.gguf4.52 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q5_1.gguf4.89 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q5_1.gguf4.89 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q5_K_M.gguf4.62 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q5_K_M.gguf4.62 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q5_K_S.gguf4.52 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q5_K_S.gguf4.52 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q5_K.gguf4.62 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q5_K.gguf4.62 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q6_K.gguf5.31 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q6_K.gguf5.31 GBdownload

fileLlama-3.1-8b-Pruned-4-Layers.Q8_0.gguf6.87 GBdownload

fileLlama-3.1-8B-Pruned-4-Layers.Q8_0.gguf6.87 GBdownload

fileREADME.md6 KBdownload

RichardErkhov/Na0s_-_Llama-3.1-8b-Pruned-4-Layers-gguf · main · files are served by the source, never re-hosted here