datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
aime_2026
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (int64): Gold final answer.
problem (string): Problem statement, usually stored as LaTeX source.
Source… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2026.aime_2025
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.
problem_type… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2025.math
Dataset Card for "livebench/math"
LiveBench is a benchmark for LLMs designed with test set contamination and objective evaluation in mind. It has the following properties:
LiveBench is designed to limit potential contamination by releasing new questions monthly, as well as having questions based on recently-released datasets, arXiv papers, news articles, and IMDb movie synopses.
Each question has verifiable, objective ground-truth answers, allowing hard questions to be scored… See the full description on the dataset page: https://huggingface.co/datasets/livebench/math.synthetic-math-toolcall-deception
Synthetic Math Tool-Call Deception
200 paired multi-turn math-assistant trajectories (400 rows) for evaluating deception
detectors on mid-trajectory tool-call misreporting.
Each trajectory: a system prompt instructs the model to compute via an execute_python
tool under a stated tool-call limit, and requires every call to carry a running
call_index argument (1 for the first call, 2 for the second, …). The platform enforcing
the limit is said to only see the reported call_index… See the full description on the dataset page: https://huggingface.co/datasets/annahbanannah/synthetic-math-toolcall-deception.aime_2024_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME I 2024 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2024_I.arxivmath
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source (float64): arXiv… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath.aime_2024_II
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME II 2024 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2024_II.miklos_2025
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from Miklos Schweitzer 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (list): Rubric… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/miklos_2025.putnam_2025
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from Putnam 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (list): Rubric or grading… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/putnam_2025.usamo_2026
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from USAMO 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (string): Rubric or… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/usamo_2026.arxivmath-0126
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source (float64): arXiv… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath-0126.arxivmath-1225
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath December 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath-1225.arxivmath-0226
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source (float64): arXiv… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath-0226.full-math-private-n256-Qwen2.5-3B-Instruct-bonbrokenarxiv
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from BrokenArXiv 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (string): Rubric or… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/brokenarxiv.brokenarxiv-0226
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from BrokenArXiv February 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/brokenarxiv-0226.brokenarxiv-0326
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from BrokenArXiv March 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/brokenarxiv-0326.full-math-private-n256-Llama-3.2-3B-Instruct-bonmath_alltime
RealTimeData Monthly Collection - Math
This datasets contains selected math question from Math Stackoverflow that were created every months from 2017 to current.
To access questions in a specific month, simple run the following:
ds = datasets.load_dataset('RealTimeData/arxiv_alltime', '2020-02')
This will give youquestions that were created in 2020-02.
Want to crawl the data by your own?
Please head to LatestEval for the crawler scripts.
Credit
This is… See the full description on the dataset page: https://huggingface.co/datasets/RealTimeData/math_alltime.preprocessed-full-math-private-n256-Llama-3.2-3B-Instruct-bonaime_2023_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2023 I used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2023_I.aime_2026_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (int64): Gold final answer.
problem (string): Problem statement, usually stored as LaTeX source.
Source… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2026_I.aime_2023_II
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2023 II used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2023_II.full-math-private-n256-Phi-4-mini-instruct-bonaime_2025_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME I 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2025_I.aime_2025_II
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME II 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2025_II.full-math-private-Qwen2.5-3B-Instruct-bonMagpie-Qwen2.5-Math-Pro-300K-v0.1
Project Web: https://magpie-align.github.io/
Arxiv Technical Report: https://arxiv.org/abs/2406.08464
Codes: https://github.com/magpie-align/magpie
Abstract
Click Here
High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human labor costs and a limited, predefined scope for prompting prevent… See the full description on the dataset page: https://huggingface.co/datasets/Magpie-Align/Magpie-Qwen2.5-Math-Pro-300K-v0.1.math500stratified-solvable-1k-math-private-Qwen2.5-3B-Instruct-bon