mlfoundations-dev/Bespoke-Stratos-7B_eval_2e29

mlfoundations-dev/Bespoke-Stratos-7Beval2e29

Precomputed model outputs for evaluation.

Evaluation Results

Summary

AIME24

• —Average Accuracy: 14.33% ± 1.57%
• —Number of Runs: 10

AMC23

• —Average Accuracy: 54.25% ± 1.77%
• —Number of Runs: 10

MATH500

• —Accuracy: 77.60% | Accuracy | Questions Solved | Total Questions | |----------|-----------------|----------------| | 77.60% | 388 | 500 |

MMLUPro

• —Average Accuracy: 34.20% ± 0.00%
• —Number of Runs: 1

JEEBench

• —Average Accuracy: 40.23% ± 1.10%
• —Number of Runs: 3

GPQADiamond

• —Average Accuracy: 31.82% ± 1.04%
• —Number of Runs: 3

LiveCodeBench

• —Average Accuracy: 27.40% ± 0.45%
• —Number of Runs: 3

CodeElo

• —Average Accuracy: 3.24% ± 0.31%
• —Number of Runs: 3

CodeForces

• —Average Accuracy: 4.78% ± 0.52%
• —Number of Runs: 3

AIME25

• —Average Accuracy: 12.67% ± 1.40%
• —Number of Runs: 10

HLE

• —Average Accuracy: 9.96% ± 0.16%
• —Number of Runs: 3

LiveCodeBenchv5

• —Average Accuracy: 16.71% ± 0.86%
• —Number of Runs: 3