CoolFace
Modelpublic

featherless-ai-quants/CarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes408downloads
root
file.gitattributes2 KBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-IQ4_XS.gguf713.7 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q2_K.gguf554.0 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q3_K_L.gguf698.6 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q3_K_M.gguf658.8 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q3_K_S.gguf612.0 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q4_K_M.gguf770.3 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q4_K_S.gguf739.7 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q5_K_M.gguf869.3 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q5_K_S.gguf851.2 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q6_K.gguf974.5 MBdownload
fileCarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-Q8_0.gguf1.23 GBdownload
filefeatherless-quants.png1.5 MBdownload
fileREADME.md4 KBdownload

featherless-ai-quants/CarrotAI-Llama-3.2-Rabbit-Ko-1B-Instruct-GGUF · main · files are served by the source, never re-hosted here