datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ArxivCap
Dataset Card for ArxivCap
Data Instances
Example-1 of single (image, caption) pairs
"......" stands for omitted parts.
{
'src': 'arXiv_src_2112_060/2112.08947',
'meta':
{
'meta_from_kaggle':
{
'journey': '',
'license': 'http://arxiv.org/licenses/nonexclusive-distrib/1.0/',
'categories': 'cs.ET'
},
'meta_from_s2':
{
'citationCount': 8… See the full description on the dataset page: https://huggingface.co/datasets/MMInstruction/ArxivCap.MINT-1T-ArXiv
🍃 MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens
🍃 MINT-1T is an open-source Multimodal INTerleaved dataset with 1 trillion text tokens and 3.4 billion images, a 10x scale-up from existing open-source datasets. Additionally, we include previously untapped sources such as PDFs and ArXiv papers. 🍃 MINT-1T is designed to facilitate research in multimodal pretraining. 🍃 MINT-1T is created by a team from the University of Washington in… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/MINT-1T-ArXiv.arxiv-latex-5TThe dataset used for https://github.com/TIGER-AI-Lab/ScholarCopilot.
arxivqa_test_subsampled_beirBEIR version of vidore/arxivqa_test_subsampled.
VisRAG-Ret-Test-ArxivQA
Dataset Description
This is a VQA dataset based on figures extracted from arXiv publications taken from ArXiVQA dataset from Multimodal ArXiV.
Load the dataset
from datasets import load_dataset
import csv
def load_beir_qrels(qrels_file):
qrels = {}
with open(qrels_file) as f:
tsvreader = csv.DictReader(f, delimiter="\t")
for row in tsvreader:
qid = row["query-id"]
pid = row["corpus-id"]
rel = int(row["score"])… See the full description on the dataset page: https://huggingface.co/datasets/openbmb/VisRAG-Ret-Test-ArxivQA.ArXivSignals
ArXivSignals — Daily arXiv Papers with LLM Signal & Summaries
A continuously-updated, day-partitioned dataset of arXiv papers (AI/ML and
adjacent categories) enriched with LLM-derived signal: a 0–100 importance
score, topical/lab tags, a one-line takeaway, and — for a selected subset —
dense full-page summaries. It powers arxivsignals.io
and is published here as an open research resource.
The dataset has two configs:
papers (default) — one row per paper: bibliography +… See the full description on the dataset page: https://huggingface.co/datasets/taesiri/ArXivSignals.arxivqa_test_subsampled_beirBEIR version of vidore/arxivqa_test_subsampled.
arxivqa_test_subsampled
Dataset Description
This is a VQA dataset based on figures extracted from arXiv publications taken from ArXiVQA dataset from Multimodal ArXiV. The questions were generated synthetically using GPT-4 Vision.
Data Curation
To ensure homogeneity across our benchmarked datasets, we subsampled the original test set to 500 pairs. Furthermore we renamed the different columns for our purpose.
Load the dataset
from datasets import load_dataset
ds =… See the full description on the dataset page: https://huggingface.co/datasets/vidore/arxivqa_test_subsampled.arxiv_hf_daily_100karxivqa_trainarxivqaarxivqa_beirThis is a copy of https://huggingface.co/datasets/jinaai/arxivqa reformatted into the BEIR format. For any further information like license, please refer to the original dataset.
Disclaimer
This dataset may contain publicly available images or text data. All data is provided for research and educational purposes only. If you are the rights holder of any content and have concerns regarding intellectual property or copyright, please contact us at "support-data (at) jina.ai" for… See the full description on the dataset page: https://huggingface.co/datasets/jinaai/arxivqa_beir.synth_arxiv_ocrArxivQA
ArxivQA
ArxivQA is one of the 11 retrieval benchmarks used in RetrievalRouter: Joint Modality and
Architecture Selection for Document Retrieval (EMNLP 2026). Each record pairs a rendered page
image, a query, and the page's extracted text, supporting both text-based and multimodal
retrieval evaluation.
📄 Paper: https://arxiv.org/pdf/2608.25625
💻 Code: https://github.com/emrekuruu/retrieval-router
🤗 Collection: https://huggingface.co/collections/emrekuruu/retrieval-router… See the full description on the dataset page: https://huggingface.co/datasets/emrekuruu/ArxivQA.ArxivQAarxiv-ocr-v0.2-smallarxiv-ocr-768px-55karxiv-chandra-ocr-2-include-images-first50-20260415
arXiv OCR with Chandra OCR 2
This output bundle stores OCR results for arXiv PDFs using datalab-to/chandra-ocr-2.
Summary
Output dataset: nielsr/arxiv-chandra-ocr-2-include-images-first50-20260415
Output bucket: hf://buckets/nielsr/arxiv-chandra-ocr-2-include-images-first50-20260415
Source paper IDs in input list: 27,584
Processed IDs recorded in state/processed_ids.txt: 50
Successes: 50
Partial successes: 0
Errors: 0
Next shard index: 10
Updated at:… See the full description on the dataset page: https://huggingface.co/datasets/nielsr/arxiv-chandra-ocr-2-include-images-first50-20260415.arxivqa_13659arxiv-ocr-v0.2Arxiv_AI_Research_Papersblue-arxiv-paperslatextract-arxiv-math
latextract-arxiv-math
A multi-domain corpus of (formula image, LaTeX source) pairs harvested from
arXiv source tarballs. Each formula is rendered in isolation with tectonic
into a tightly-cropped PNG; the ground-truth LaTeX is the body of the original
display-math environment, normalized to remove \label{...}.
Provenance
Source: arXiv e-print/<id> tarballs (publicly downloadable)
Renderer: tectonic (LaTeX engine) + MuPDF (PDF → PNG @ 200 DPI)
Filtering: papers using… See the full description on the dataset page: https://huggingface.co/datasets/tbrrss/latextract-arxiv-math.arxiv-page-ocr-bench
arXiv Page OCR Benchmark Corpus
Dataset Summary
arXiv Page OCR Benchmark Corpus is an evaluation benchmark dataset containing high-resolution rendered document page images from scientific arXiv papers (covering STEM disciplines including physics, computer science, mathematics, and quantitative finance) paired with ground-truth Markdown / LaTeX text representations.
This dataset is designed to evaluate document parsing, optical character recognition (OCR), and… See the full description on the dataset page: https://huggingface.co/datasets/Srijan-Upadhyay/arxiv-page-ocr-bench.deepsynth-en-arxiv
DeepSynth - arXiv Scientific Paper Summarization
Dataset Description
Scientific paper abstracts from arXiv, covering computer science, physics, and mathematics.
Visual encoding preserves mathematical notation and document structure critical for scientific summarization.
This dataset is part of the DeepSynth project, which uses visual text encoding for multilingual summarization with the DeepSeek-OCR vision-language model. Text documents are converted into images and… See the full description on the dataset page: https://huggingface.co/datasets/baconnier/deepsynth-en-arxiv.arxiv-ocr-v0.1-sftNayana-OCRBench-in-0.6k-v1-arxivarxivqa_test_subsampled_tesseractarxiv-struct-100k
ArXiv Paper Structure Dataset
数据集的图片内容来自arXiv的论文PDF，图片的结构标注来自SimpleTex的模型识别，识别结果已经经过一次简单的筛选，剔除部分错的太明显的样本，不过剩余样本中也有一些存在错位的样本。
英文的图片是原始的arXiv论文，中文的部分使用翻译模型进行自动翻译得到，可能存在不准确的内容。
arxiv-pdfs