CoolFace
Modelpublic

bartowski/Mellum2-12B-A2.5B-Thinking-GGUF

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
6likes1.9kdownloads
fileMellum2-12B-A2.5B-Thinking-bf16.gguf22.64 GBdownload
fileMellum2-12B-A2.5B-Thinking-imatrix.gguf39.1 MBdownload
fileMellum2-12B-A2.5B-Thinking-IQ2_M.gguf4.75 GBdownload
fileMellum2-12B-A2.5B-Thinking-IQ2_S.gguf4.53 GBdownload
fileMellum2-12B-A2.5B-Thinking-IQ2_XS.gguf4.48 GBdownload
fileMellum2-12B-A2.5B-Thinking-IQ3_M.gguf5.89 GBdownload
fileMellum2-12B-A2.5B-Thinking-IQ3_XS.gguf5.75 GBdownload
fileMellum2-12B-A2.5B-Thinking-IQ3_XXS.gguf5.40 GBdownload
fileMellum2-12B-A2.5B-Thinking-IQ4_NL.gguf6.53 GBdownload
fileMellum2-12B-A2.5B-Thinking-IQ4_XS.gguf6.30 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q2_K_L.gguf5.01 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q2_K.gguf4.81 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q3_K_L.gguf5.83 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q3_K_M.gguf5.75 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q3_K_S.gguf5.54 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q3_K_XL.gguf6.01 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q4_0.gguf6.52 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q4_1.gguf7.18 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q4_K_L.gguf7.76 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q4_K_M.gguf7.61 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q4_K_S.gguf7.04 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q5_K_L.gguf8.78 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q5_K_M.gguf8.65 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q5_K_S.gguf8.08 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q6_K_L.gguf10.34 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q6_K.gguf10.24 GBdownload
fileMellum2-12B-A2.5B-Thinking-Q8_0.gguf12.04 GBdownload

bartowski/Mellum2-12B-A2.5B-Thinking-GGUF · main · files are served by the source, never re-hosted here