mlfoundations-dev/Eurus-2-7B-SFT_eval_2e29

mlfoundations-dev/Eurus-2-7B-SFTeval2e29

Precomputed model outputs for evaluation.

Evaluation Results

Summary

AIME24

• —Average Accuracy: 2.33% ± 0.67%
• —Number of Runs: 10

AMC23

• —Average Accuracy: 21.00% ± 1.42%
• —Number of Runs: 10

MATH500

• —Accuracy: 30.60% | Accuracy | Questions Solved | Total Questions | |----------|-----------------|----------------| | 30.60% | 153 | 500 |

MMLUPro

• —Average Accuracy: 11.00% ± 0.00%
• —Number of Runs: 1

JEEBench

• —Average Accuracy: 11.36% ± 0.67%
• —Number of Runs: 3

GPQADiamond

• —Average Accuracy: 10.44% ± 0.50%
• —Number of Runs: 3

LiveCodeBench

• —Average Accuracy: 6.78% ± 0.79%
• —Number of Runs: 3

CodeElo

• —Average Accuracy: 1.53% ± 0.15%
• —Number of Runs: 3

CodeForces

• —Average Accuracy: 2.06% ± 0.19%
• —Number of Runs: 3

AIME25

• —Average Accuracy: 1.33% ± 0.52%
• —Number of Runs: 10

HLE

• —Average Accuracy: 4.10% ± 0.18%
• —Number of Runs: 3

LiveCodeBenchv5

• —Average Accuracy: 4.43% ± 0.09%
• —Number of Runs: 3