Modelpublic

nbeerbower/phi3.5-gutenberg-4B

sourceHugging Facemitupdated 2y agoView on Hugging Face

4likes51downloads

Model Card

phi3.5-gutenberg-4B

microsoft/Phi-3.5-mini-instruct finetuned on jondurbin/gutenberg-dpo-v0.1.

Method

Finetuned using 2x RTX 4060 Ti for 3 epochs.

Fine-tune Llama 3 with ORPO