Datasetpublic

mlfoundations-dev/Bespoke-Stratos-7B_1743983930_eval_68a0

mlfoundations-dev/Bespoke-Stratos-7B_1743983930_eval_68a0 Precomputed model outputs for evaluation. Evaluation Results Summary Metric AIME24 AIME25 AMC23 MATH500 Accuracy 12.7 13.3 53.0 76.0 AIME24 Average Accuracy: 12.67% ± 1.74% Number of Runs: 5 Run Accuracy Questions Solved Total Questions 1 10.00% 3 30 2 16.67% 5 30 3 6.67% 2 30 4 16.67% 5 30 5 13.33% 4 30 AIME25 Average… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/Bespoke-Stratos-7B_1743983930_eval_68a0.

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes7downloads

Dataset Card

mlfoundations-dev/Bespoke-Stratos-7B1743983930eval_68a0

Precomputed model outputs for evaluation.

Evaluation Results

Summary

Metric	AIME24	AIME25	AMC23	MATH500
Accuracy	12.7	13.3	53.0	76.0

AIME24

—Average Accuracy: 12.67% ± 1.74%
—Number of Runs: 5

Run	Accuracy	Questions Solved	Total Questions
1	10.00%	3	30
2	16.67%	5	30
3	6.67%	2	30
4	16.67%	5	30
5	13.33%	4	30

AIME25

—Average Accuracy: 13.33% ± 1.33%
—Number of Runs: 5

Run	Accuracy	Questions Solved	Total Questions
1	10.00%	3	30
2	13.33%	4	30
3	16.67%	5	30
4	16.67%	5	30
5	10.00%	3	30

AMC23

—Average Accuracy: 53.00% ± 1.30%
—Number of Runs: 5

Run	Accuracy	Questions Solved	Total Questions
1	52.50%	21	40
2	50.00%	20	40
3	55.00%	22	40
4	57.50%	23	40
5	50.00%	20	40

MATH500

—Accuracy: 76.00% | Accuracy | Questions Solved | Total Questions | |----------|-----------------|----------------| | 76.00% | 380 | 500 |