CoolFace
Modelpublic

mradermacher/CantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged-GGUF

sourceHugging Faceapache-2.0updated 19d agoView on Hugging Face
1likes1.1kdownloads
root
file.gitattributes3 KBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.IQ4_XS.gguf15.42 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q2_K.gguf10.49 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q3_K_L.gguf14.81 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q3_K_M.gguf13.70 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q3_K_S.gguf12.38 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q4_K_M.gguf17.28 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q4_K_S.gguf16.26 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q5_K_M.gguf20.23 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q5_K_S.gguf19.63 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q6_K.gguf23.37 GBdownload
fileCantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged.Q8_0.gguf30.25 GBdownload
fileREADME.md4 KBdownload

mradermacher/CantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged-GGUF · main · files are served by the source, never re-hosted here