Modelpublic

nbeerbower/Mistral-Small-Gutenberg-Doppel-22B

sourceHugging Faceotherupdated 2y agoView on Hugging Face

12likes245downloads

Model Card

image/png

Mistral-Small-Gutenberg-Doppel-22B

mistralai/Mistral-Small-Instruct-2409 finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.

Method

ORPO tuned with an A40 on RunPod (plz sponsor me) for 3 epochs.

Fine-tune Llama 3 with ORPO