Modelpublic

cloudyu/Yi-34Bx2-MoE-60B-DPO

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

3likes8.7kdownloads

Model Card

—This is DPO improved version of cloudyu/Yi-34Bx2-MoE-60B

—DPO Trainer

—metrics not test!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	25.91
IFEval (0-Shot)	53.19
BBH (3-Shot)	31.26
MATH Lvl 5 (4-Shot)	6.19
GPQA (0-shot)	9.62
MuSR (0-shot)	14.32
MMLU-PRO (5-shot)	40.85