Modelpublic

mradermacher/Colibri-RAG-Llama-3.2-3B-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes481downloads

fileColibri-RAG-Llama-3.2-3B.f16.gguf5.99 GBdownload

fileColibri-RAG-Llama-3.2-3B.IQ3_M.gguf1.49 GBdownload

fileColibri-RAG-Llama-3.2-3B.IQ3_S.gguf1.44 GBdownload

fileColibri-RAG-Llama-3.2-3B.IQ3_XS.gguf1.38 GBdownload

fileColibri-RAG-Llama-3.2-3B.IQ4_XS.gguf1.71 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q2_K.gguf1.27 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q3_K_L.gguf1.69 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q3_K_M.gguf1.57 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q3_K_S.gguf1.44 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q4_K_M.gguf1.88 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q4_K_S.gguf1.80 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q5_K_M.gguf2.16 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q5_K_S.gguf2.11 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q6_K.gguf2.46 GBdownload

fileColibri-RAG-Llama-3.2-3B.Q8_0.gguf3.19 GBdownload

mradermacher/Colibri-RAG-Llama-3.2-3B-GGUF · main · files are served by the source, never re-hosted here