ksw1/DPO-2-10k

Uploaded model

• —Developed by: ksw1
• —License: apache-2.0
• —Finetuned from model : ksw1/llama-3-8b-sleeper-agent
• —Data that was used to train this model can be found on HuggingFace at: ksw1/cs224n-dpo-2

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>