Modelpublic

RichardErkhov/Aarushhh_-_untrained-pruned-customffn-llama3.1-8b-large-gguf

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes531downloads

fileuntrained-pruned-customffn-llama3.1-8b-large.IQ3_M.gguf1.74 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.IQ3_S.gguf1.74 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.IQ3_XS.gguf1.67 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.IQ4_NL.gguf2.14 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.IQ4_XS.gguf2.05 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q2_K.gguf1.51 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q3_K_L.gguf1.96 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q3_K_M.gguf1.85 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q3_K_S.gguf1.73 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q3_K.gguf1.85 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q4_0.gguf2.14 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q4_1.gguf2.34 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q4_K_M.gguf2.25 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q4_K_S.gguf2.14 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q4_K.gguf2.25 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q5_0.gguf2.53 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q5_1.gguf2.72 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q5_K_M.gguf2.58 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q5_K_S.gguf2.53 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q5_K.gguf2.58 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q6_K.gguf2.94 GBdownload

fileuntrained-pruned-customffn-llama3.1-8b-large.Q8_0.gguf3.80 GBdownload

RichardErkhov/Aarushhh_-_untrained-pruned-customffn-llama3.1-8b-large-gguf · main · files are served by the source, never re-hosted here