thewordsmiths/Meta-Llama-3-8B_sft_merged_100000_dpo_merged_sft-mcq_LoRA

Uploaded model

• —Developed by: thewordsmiths
• —License: apache-2.0
• —Finetuned from model : thewordsmiths/Meta-Llama-3-8Bsftmerged100000dpo_merged

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>