NeuR0mancR/Pale-Sonneteer-24B-GGUF

[image]

"Je meurs aussi de ta mélancolie... Un soir de demi-brume" – d'après Nelligan et Apollinaire

Pale Sonneteer - Gothic Poet

The GGUF version of my first model. An experiment with karcher. The Pale Sonneteer is a writing/RP model.

About

These are static and weighted/imatrix quants of https://huggingface.co/NeuR0mancR/Pale-Sonneteer

The IQ-quants and imatrix quants were calibrated with a custom importance matrix to preserve metaphorical depth and dark-academic vocabulary, to stay in line with the model's theme. Feel free to requantize with your own if you desire to preserve a different set of weights. The imatrix.dat used is included in this repo. IQ quants are recommended over similar sized non-IQ quantization.

Feel free to share your feedbacks and let me know if you encounter weird behaviour during inference.

Note: The `IQ` and `K_M` quants use the custom Gothic imatrix. Static quants (`Q6_K`, `Q8_0`) are provided for purists.