Datasetpublic

mlfoundations-dev/ot3_300k_more_ckpts_step1000_eval_27e9

mlfoundations-dev/ot3_300k_more_ckpts_step1000_eval_27e9 Precomputed model outputs for evaluation. Evaluation Results LiveCodeBench Average Accuracy: 34.64% ± 0.87% Number of Runs: 6 Run Accuracy Questions Solved Total Questions 1 33.86% 173 511 2 30.92% 158 511 3 36.79% 188 511 4 35.62% 182 511 5 34.44% 176 511 6 36.20% 185 511

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes6downloads

Dataset Card

mlfoundations-dev/ot3300kmoreckptsstep1000eval27e9

Precomputed model outputs for evaluation.

Evaluation Results

LiveCodeBench

—Average Accuracy: 34.64% ± 0.87%
—Number of Runs: 6

Run	Accuracy	Questions Solved	Total Questions
1	33.86%	173	511
2	30.92%	158	511
3	36.79%	188	511
4	35.62%	182	511
5	34.44%	176	511
6	36.20%	185	511