yifengw3/tulu3-olmo2-1124-7b-unsafe-from-DPO-training

Uploaded finetuned model

• —Developed by: yifengw3
• —License: apache-2.0
• —Finetuned from model : yifengw3/tulu3-olmo2-1124-7b-DPO-training-5epochs_1e-5

This olmo2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>