Modelpublic

mradermacher/DictaLM-3.0-24B-Base-GGUF

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes499downloads

fileDictaLM-3.0-24B-Base.IQ4_XS.gguf12.00 GBdownload

fileDictaLM-3.0-24B-Base.Q2_K.gguf8.28 GBdownload

fileDictaLM-3.0-24B-Base.Q3_K_L.gguf11.55 GBdownload

fileDictaLM-3.0-24B-Base.Q3_K_M.gguf10.69 GBdownload

fileDictaLM-3.0-24B-Base.Q3_K_S.gguf9.69 GBdownload

fileDictaLM-3.0-24B-Base.Q4_K_M.gguf13.35 GBdownload

fileDictaLM-3.0-24B-Base.Q4_K_S.gguf12.62 GBdownload

fileDictaLM-3.0-24B-Base.Q5_K_M.gguf15.61 GBdownload

fileDictaLM-3.0-24B-Base.Q5_K_S.gguf15.18 GBdownload

fileDictaLM-3.0-24B-Base.Q6_K.gguf18.02 GBdownload

fileDictaLM-3.0-24B-Base.Q8_0.gguf23.33 GBdownload

mradermacher/DictaLM-3.0-24B-Base-GGUF · main · files are served by the source, never re-hosted here