Modelpublic

InferenceIllusionist/magnum-12b-v2.5-kto-iMat-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

2likes908downloads

21 commits on main

cc0e2e82y ago

Rename magnum-12B-kto-v2.5-F16.gguf to magnum-12b-v2.5-kto-fp16.gguf

InferenceIllusionist

ffc4fa72y ago

Upload magnum-12B-kto-v2.5-F16.gguf

InferenceIllusionist

77fcce82y ago

Upload magnum-12b-v2.5-kto-iMat-IQ2_M.gguf

InferenceIllusionist

0d9c3ed2y ago

Upload 3 files

InferenceIllusionist

8f722822y ago

Upload magnum-12b-v2.5-kto-iMat-IQ3_M.gguf

InferenceIllusionist

80c779b2y ago

Upload magnum-12b-v2.5-kto-iMat-IQ4_XS.gguf

InferenceIllusionist

29924832y ago

Upload magnum-12b-v2.5-kto-iMat-Q2_K.gguf

InferenceIllusionist

8e5bae52y ago

Upload magnum-12b-v2.5-kto-iMat-Q3_K_S.gguf

InferenceIllusionist

ad5b38d2y ago

Upload magnum-12b-v2.5-kto-iMat-Q3_K_M.gguf

InferenceIllusionist

9318a5c2y ago

Upload magnum-12b-v2.5-kto-iMat-Q3_K_L.gguf

InferenceIllusionist

19b77df2y ago

Upload magnum-12b-v2.5-kto-iMat-Q4_K_S.gguf

InferenceIllusionist

800fb502y ago

Upload magnum-12b-v2.5-kto-iMat-Q4_K_M.gguf

InferenceIllusionist

c97fb412y ago

Upload magnum-12b-v2.5-kto-fp16.imatrix

InferenceIllusionist

cc50f922y ago

Upload magnum-12b-v2.5-kto-iMat-Q5_K_S.gguf

InferenceIllusionist

628bb102y ago

Update README.md

InferenceIllusionist

bf52a352y ago

Upload magnum-12b-v2.5-kto-iMat-Q5_K_M.gguf

InferenceIllusionist

f506bf62y ago

Update README.md

InferenceIllusionist

7e3b1602y ago

Upload magnum-12b-v2.5-kto-iMat-Q6_K.gguf

InferenceIllusionist

45d855c2y ago

Upload magnum-12b-v2.5-kto-iMat-Q8_0.gguf

InferenceIllusionist

4c9131d2y ago

Update README.md

InferenceIllusionist

ba178242y ago

initial commit

InferenceIllusionist