Modelpublic

nbeerbower/Mistral-Nemo-Gutenberg-Doppel-12B-v2

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

8likes42downloads

Model Card

image/png

Mistral-Nemo-Gutenberg-Doppel-12B

axolotl-ai-co/romulus-mistral-nemo-12b-simpo finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.

Method

ORPO tuned with 2x A100 for 3 epochs.