Modelpublic

mradermacher/Llama-3.2-3B-Instruct-Sunbird-Dialogue-RAG-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes274downloads

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.f16.gguf5.99 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.IQ4_XS.gguf1.71 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q2_K.gguf1.27 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q3_K_L.gguf1.69 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q3_K_M.gguf1.57 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q3_K_S.gguf1.44 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q4_0_4_4.gguf1.79 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q4_K_M.gguf1.88 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q4_K_S.gguf1.80 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q5_K_M.gguf2.16 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q5_K_S.gguf2.11 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q6_K.gguf2.46 GBdownload

fileLlama-3.2-3B-Instruct-Sunbird-Dialogue-RAG.Q8_0.gguf3.19 GBdownload

mradermacher/Llama-3.2-3B-Instruct-Sunbird-Dialogue-RAG-GGUF · main · files are served by the source, never re-hosted here