Modelpublic

abacusai/MM-Orc-Vic-bagel-34b-c1000

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

1likes66downloads

Model Card

Finetune of the DPO Bagel model (https://huggingface.co/jondurbin/nontoxic-bagel-34b-v0.2) on the MetamathFewshot (https://huggingface.co/datasets/abacusai/MetaMathFewshot) dataset

Evaluation Results

Average	ARC	HellaSwag	MMLU	TruthfulQA	Winogrande	GSM8K

For comparison the GSM8K score for the original nontoxic-bagel-34b-v0.2 model was 58.45 and average score was 74.69