QuantFactory/L3.1-8B-komorebi-GGUF

license: llama3 licensename: llama3 licenselink: LICENSE library_name: transformers tags:

• —not-for-all-audiences datasets:
• —crestf411/LimaRP-DS


QuantFactory/L3.1-8B-komorebi-GGUF

This is quantized version of crestf411/L3.1-8B-komorebi created using llama.cpp

Original Model Card

This is a model based on a multi-phase process using KTO fine tuning using the jondurbin gutenberg approach, that results in 3 separate LoRAs which are merged in sequence.

The resulting model is exhibiting a significant decrease in Llama 3.1 slop outputs.

Experimental. Please give feedback. Begone if you demand perfection.

I did most of my testing with temp 1.4, min-p 0.15, DRY 0.8. I also did play with enabling XTC with threshold 0.1, prob 0.50.

As context grows, you may want to bump temp and min-p and maybe even DRY.