Modelpublic

mradermacher/magnum-12b-v2.5-kto-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

1likes512downloads

filemagnum-12b-v2.5-kto.IQ4_XS.gguf6.33 GBdownload

filemagnum-12b-v2.5-kto.Q2_K.gguf4.46 GBdownload

filemagnum-12b-v2.5-kto.Q3_K_L.gguf6.11 GBdownload

filemagnum-12b-v2.5-kto.Q3_K_M.gguf5.67 GBdownload

filemagnum-12b-v2.5-kto.Q3_K_S.gguf5.15 GBdownload

filemagnum-12b-v2.5-kto.Q4_0_4_4.gguf6.59 GBdownload

filemagnum-12b-v2.5-kto.Q4_K_M.gguf6.96 GBdownload

filemagnum-12b-v2.5-kto.Q4_K_S.gguf6.63 GBdownload

filemagnum-12b-v2.5-kto.Q5_K_M.gguf8.13 GBdownload

filemagnum-12b-v2.5-kto.Q5_K_S.gguf7.93 GBdownload

filemagnum-12b-v2.5-kto.Q6_K.gguf9.37 GBdownload

filemagnum-12b-v2.5-kto.Q8_0.gguf12.13 GBdownload

mradermacher/magnum-12b-v2.5-kto-GGUF · main · files are served by the source, never re-hosted here