princeton-nlp/Mistral-7B-Base-SFT-IPO
053
This is a model released from the preprint: [SimPO: Simple Preference Optimization with a Reference-Free Reward](https://arxiv.org/abs/2405.14734) Please refer to our repository for more details.
This is a model released from the preprint: [SimPO: Simple Preference Optimization with a Reference-Free Reward](https://arxiv.org/abs/2405.14734) Please refer to our repository for more details.