CoolFace
Datasetpublic

INSAIT-Institute/SaberMath-documents

SABER-Math Documents Document corpus for the SABER-Math mathematical information reranking benchmark. Each of the 71,117 entries is a competition-style math problem together with its solution, serving as a retrievable document. The candidates field in SABER-Math Queries indexes into this corpus. Dataset structure Each example contains: Field Type… See the full description on the dataset page: https://huggingface.co/datasets/INSAIT-Institute/SaberMath-documents.

sourceHugging Facecc-by-sa-4.0updated 1mo agoView on Hugging Face
0likes584downloads
Dataset Card

<div align="center"> <img src="https://raw.githubusercontent.com/insait-institute/sabermath/refs/heads/master/images/sabermathlogo.png" width="40%" alt="SaberMath" /> </div> <hr> <div align="center" style="line-height: 1;"> <a href="https://sabermath.insait.ai/" target="blank" style="margin: 2px;"> <img alt="Homepage" src="https://img.shields.io/badge/Homepage-SABERMath-ffc107?color=00c107&logoColor=white" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://github.com/insait-institute/sabermath" target="blank" style="margin: 2px;"> <img alt="GitHub" src="https://img.shields.io/badge/GitHub-SABERMath-ffc107?logo=github&color=c10000&logoColor=white" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://arxiv.org/abs/2606.29894" target="blank" style="margin: 2px;"> <img alt="arXiv" src="https://img.shields.io/badge/arXiv-2606.29894-b31b1b?logo=arxiv&logoColor=white" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://huggingface.co/collections/INSAIT-Institute/saber-math" target="_blank" style="margin: 2px;"> <img alt="SABER-Math HuggingFace" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-SABERMath-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://creativecommons.org/licenses/by-sa/4.0/deed.en" style="margin: 2px;"> <img alt="License" src="https://img.shields.io/badge/License-CC%20BY--SA%204.0-blue" style="display: inline-block; vertical-align: middle;"/> </a> </div> <br/>

SABER-Math Documents

Document corpus for the SABER-Math mathematical information reranking benchmark. Each of the 71,117 entries is a competition-style math problem together with its solution, serving as a retrievable document. The candidates field in SABER-Math Queries indexes into this corpus.

Dataset structure

Each example contains:

FieldTypeDescription
idstringUnique document identifier
problemstringProblem statement
solutionstringFull worked solution to the problem
answerstringFinal answer
ideastringShort description of the key idea / proof technique
tagslist[string]Topic tags for the problem
domainslist[string]Mathematical domains (e.g. algebra, number theory)
metadatastructProvenance: competition, source, originating dataset, and the raw forum posts (BBCode/HTML content, timestamps, authors, attachments) the problem was extracted from
original_indexint64Index of the document in the source dataset

Document indices referenced by the candidates lists in SABER-Math Queries correspond to row positions in this corpus.

Inspection

python
from datasets import load_dataset

docs = load_dataset("INSAIT-Institute/SaberMath-documents", split="train")
queries = load_dataset("INSAIT-Institute/SaberMath-queries", split="train")

q = queries[0]
print(q["problem"])
for idx, rel in zip(q["candidates"], q["relevance_scores"]):
    print(rel, docs[idx]["problem"][:80])

Follow the code in the GitHub repository to run the end to end evaluation.

Licensing

The CC BY-SA 4.0 license applies to the benchmark material authored by us (annotations, judgments, curation, and derived fields). Redistributed source text remains subject to the terms of its original source:

  • —NuminaMath: retains the conditions of its original Apache 2.0 license.
  • —AoPS: not available for model training and subject to the applicable AoPS restrictions, which require attribution when the resources are used as input to an AI system. These entries are explicitly marked in the dataset.
  • —Official competition problems: typically in the public domain or released under usage conditions similar to the above, forbidding the use of the data for training. Users are responsible for complying with the original source terms for each entry. See the metadata fields (dataset, source, competition) to identify the provenance of individual examples.

Citation

You can check out the full paper on ArXiv.

bibtex
@inproceedings{
  georgiev2026sabermath,
  title={{SABER}-Math: An Automated Reranking Benchmark for Mathematical Information Retrieval},
  author={Anonymous},
  booktitle={The 2026 Conference on Empirical Methods in Natural Language Processing},
  year={2026},
  url={https://openreview.net/forum?id=Tb2EKLtAS0}
}