Snqwii/Rose-Engine-12B-i1-GGUF

Snqwii/Rose-Engine-12B

Weighted quants of `Snqwii/Rose-Engine-12B` converted using llama.cpp. Refer to the original model card for more details on the model.

Static quants are available at https://huggingface.co/Snqwii/Rose-Engine-12B-GGUF

Provided Quantizations:

• —Q4_K_M
• —Q4_K_S
• —Q6_K
• —Q8_0

Credits

Massive thanks to mradermacher for their imatrix.gguf! These quants would not be possible without them!