Coder-Stat
Coder-Stat
Coder-Stat Dataset
Overview
The Coder-Stat dataset is a collection of programming-related data, including problem IDs, programming languages, original statuses, and source code snippets. This dataset is designed to assist in the analysis of coding patterns, error types, and performance metrics.
Dataset Details
Modalities
Tabular: The dataset is structured in a tabular format.
Text: Contains text data, including source code snippets.
Formats… See the full description on the dataset page: https://huggingface.co/datasets/prithivMLmods/Coder-Stat.a1_code_coder_stat_eval_636d
mlfoundations-dev/a1_code_coder_stat_eval_636d
Precomputed model outputs for evaluation.
Evaluation Results
Summary
Metric
AIME24
AMC23
MATH500
MMLUPro
JEEBench
GPQADiamond
LiveCodeBench
CodeElo
CodeForces
Accuracy
14.3
59.2
75.6
32.0
40.1
42.3
21.5
10.5
10.2
AIME24
Average Accuracy: 14.33% ± 1.25%
Number of Runs: 10
Run
Accuracy
Questions Solved
Total Questions
1
10.00%
3
30
2
16.67%
5
30
3
20.00%
6
30
4
16.67%
5… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/a1_code_coder_stat_eval_636d.a1_code_coder_statcoder_stat
