CoolFace
Modelpublic

featherless-ai-quants/neuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes376downloads
root
file.gitattributes3 KBdownload
filefeatherless-quants.png1.5 MBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-IQ4_XS.gguf4.18 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q2_K.gguf2.96 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q3_K_L.gguf4.03 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q3_K_M.gguf3.74 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q3_K_S.gguf3.41 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q4_K_M.gguf4.58 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q4_K_S.gguf4.37 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q5_K_M.gguf5.34 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q5_K_S.gguf5.21 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q6_K.gguf6.14 GBdownload
fileneuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-Q8_0.gguf7.95 GBdownload
fileREADME.md4 KBdownload

featherless-ai-quants/neuralmagic-Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF · main · files are served by the source, never re-hosted here