Modelpublic

featherless-ai-quants/dat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes505downloads

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-IQ4_XS.gguf713.7 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q2_K.gguf554.0 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q3_K_L.gguf698.6 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q3_K_M.gguf658.8 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q3_K_S.gguf612.0 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q4_K_M.gguf770.3 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q4_K_S.gguf739.7 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q5_K_M.gguf869.3 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q5_K_S.gguf851.2 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q6_K.gguf974.5 MBdownload

filedat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-Q8_0.gguf1.23 GBdownload

featherless-ai-quants/dat-lequoc-vLLM-fast-apply-16bit-v0.13-Llama3.2-1B-GGUF · main · files are served by the source, never re-hosted here