CoolFace
Modelpublic

Lewdiculous/MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix

sourceHugging Faceunlicenseupdated 2y agoView on Hugging Face
13likes1.3kdownloads
Model Card

My GGUF-IQ-ARM-Imatrix quants for **inflatebot/MN-12B-Mag-Mell-R1**.

Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too "hot". If issues with coherency occur, try increasing MinP or decreasing Temperature.
[!NOTE] Use the ChatML prompt format.

model-card-image