freewheelin/free-llama3-dpo-v0.2

Model Card for free-llama-dpo-v0.2

Developed by : Freewheelin AI Technical Team

Hardware and Software

• —Training Factors: We fine-tuned this model using the HuggingFace TRL Trainer

Method

• —This model was trained using the learning method introduced in the SOLAR paper.