YichengWangCA/aime24-official
AIME 2024 — official wording, figures retained All 30 problems from the 2024 American Invitational Mathematics Examination (AIME I and AIME II), transcribed from the official exam text with every figure retained as Asymptote source. This exists because the circulating text-only versions of AIME 2024 are not faithful to the official problems, and at least one problem in them cannot be solved as written. Why this dataset exists While evaluating a reasoning model on… See the full description on the dataset page: https://huggingface.co/datasets/YichengWangCA/aime24-official.
AIME 2024 — official wording, figures retained
All 30 problems from the 2024 American Invitational Mathematics Examination (AIME I and AIME II), transcribed from the official exam text with every figure retained as Asymptote source.
This exists because the circulating text-only versions of AIME 2024 are not faithful to the official problems, and at least one problem in them cannot be solved as written.
Why this dataset exists
While evaluating a reasoning model on AIME 2024, I found a problem the model failed on all 64 sampled attempts. Reading it myself, the statement was under-determined — the question had no unique answer as written.
The problem that lose constraint
2024 AIME I-8 (chain of tangent circles). The official statement specifies that all circles are tangent to $\overline{BC}$, with the first tangent to $\overline{AB}$ and the last tangent to $\overline{AC}$. The circulating text drops all of this, and figure-free versions also drop the Asymptote source that would have carried it visually. Without the constraint the chain may bend arbitrarily, infinitely many triangles satisfy the statement, and the requested inradius is not unique. The problem is unanswerable as distributed.
Format
One JSON object per line:
{
"ID": "2024-I-8",
"Problem": "Eight circles of radius $34$ can be placed tangent to $\\overline{BC}$ ... [asy] ... [/asy]",
"Answer": "197",
"url": "https://artofproblemsolving.com/wiki/index.php/2024_AIME_I_Problems/Problem_8",
"has_figure": true
}Field names are capitalised for drop-in compatibility with loaders that auto-detect Problem/Answer/ID columns.
Usage
from datasets import load_dataset
ds = load_dataset("YichengWangCA/aime24-official", split="train")
print(ds[7]["Problem"], ds[7]["Answer"])Six problems contain Asymptote source. If your model cannot use it, strip the [asy]...[/asy] blocks — but note that for I-8 the official prose is self-contained, so stripping the figure is safe here in a way it is not for the versions this dataset replaces.
Evaluation notes
- Answers are single integers in $[0, 999]$, so correctness is a decision rather than a judgement. Prompt for a final answer inside
\boxed{}and extract it.
Provenance and limitations
- Transcribed from the official complete-exam text rather than per-problem community pages, which is where the drift in other versions originates.
Attribution
Problems are from the 2024 AIME, administered by the Mathematical Association of America. This dataset is a transcription for research and evaluation use; the problems themselves are the work of the MAA and its problem authors. The license field applies to the compilation, formatting, and accompanying documentation, not to the underlying problems.
