mlfoundations-dev/bespoke_stratos_3k_eval_636d

mlfoundations-dev/fig1_scaling_bespoke_stratos_3k_eval_636d Precomputed model outputs for evaluation. Evaluation Results Summary Metric AIME24 AMC23 MATH500 MMLUPro JEEBench GPQADiamond LiveCodeBench CodeElo CodeForces Accuracy 17.7 60.5 77.6 28.2 41.1 43.3 30.7 5.5 7.7 AIME24 Average Accuracy: 17.67% ± 1.64% Number of Runs: 10 Run Accuracy Questions Solved Total Questions 1 16.67% 5 30 2 16.67% 5 30 3… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/bespoke_stratos_3k_eval_636d.