qgallouedec/online-dpo-qwen2-2

Model Card for online-dpo-qwen2-2

This model is a fine-tuned version of Qwen/Qwen2-0.5B-Instruct on the https://huggingface.co/datasets/trl-lib/ultrafeedback-prompt dataset.