datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ArxivCap
Dataset Card for ArxivCap
Data Instances
Example-1 of single (image, caption) pairs
"......" stands for omitted parts.
{
'src': 'arXiv_src_2112_060/2112.08947',
'meta':
{
'meta_from_kaggle':
{
'journey': '',
'license': 'http://arxiv.org/licenses/nonexclusive-distrib/1.0/',
'categories': 'cs.ET'
},
'meta_from_s2':
{
'citationCount': 8… See the full description on the dataset page: https://huggingface.co/datasets/MMInstruction/ArxivCap.MINT-1T-ArXiv
🍃 MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens
🍃 MINT-1T is an open-source Multimodal INTerleaved dataset with 1 trillion text tokens and 3.4 billion images, a 10x scale-up from existing open-source datasets. Additionally, we include previously untapped sources such as PDFs and ArXiv papers. 🍃 MINT-1T is designed to facilitate research in multimodal pretraining. 🍃 MINT-1T is created by a team from the University of Washington in… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/MINT-1T-ArXiv.arxiv-latex-5TThe dataset used for https://github.com/TIGER-AI-Lab/ScholarCopilot.
arxivqa_test_subsampled_beirBEIR version of vidore/arxivqa_test_subsampled.
VisRAG-Ret-Test-ArxivQA
Dataset Description
This is a VQA dataset based on figures extracted from arXiv publications taken from ArXiVQA dataset from Multimodal ArXiV.
Load the dataset
from datasets import load_dataset
import csv
def load_beir_qrels(qrels_file):
qrels = {}
with open(qrels_file) as f:
tsvreader = csv.DictReader(f, delimiter="\t")
for row in tsvreader:
qid = row["query-id"]
pid = row["corpus-id"]
rel = int(row["score"])… See the full description on the dataset page: https://huggingface.co/datasets/openbmb/VisRAG-Ret-Test-ArxivQA.ArXivSignals
ArXivSignals — Daily arXiv Papers with LLM Signal & Summaries
A continuously-updated, day-partitioned dataset of arXiv papers (AI/ML and
adjacent categories) enriched with LLM-derived signal: a 0–100 importance
score, topical/lab tags, a one-line takeaway, and — for a selected subset —
dense full-page summaries. It powers arxivsignals.io
and is published here as an open research resource.
The dataset has two configs:
papers (default) — one row per paper: bibliography +… See the full description on the dataset page: https://huggingface.co/datasets/taesiri/ArXivSignals.arxivqa_test_subsampled_beirBEIR version of vidore/arxivqa_test_subsampled.
arxivqa_test_subsampled
Dataset Description
This is a VQA dataset based on figures extracted from arXiv publications taken from ArXiVQA dataset from Multimodal ArXiV. The questions were generated synthetically using GPT-4 Vision.
Data Curation
To ensure homogeneity across our benchmarked datasets, we subsampled the original test set to 500 pairs. Furthermore we renamed the different columns for our purpose.
Load the dataset
from datasets import load_dataset
ds =… See the full description on the dataset page: https://huggingface.co/datasets/vidore/arxivqa_test_subsampled.arxiv_hf_daily_100karxivqa_trainarxivqaarx-basket2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "arx",
"total_episodes": 28,
"total_frames": 11358,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:28"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/rdoshi21/arx-basket2.arx-tape2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "arx",
"total_episodes": 28,
"total_frames": 32860,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:28"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/rdoshi21/arx-tape2.arxivqa_beirThis is a copy of https://huggingface.co/datasets/jinaai/arxivqa reformatted into the BEIR format. For any further information like license, please refer to the original dataset.
Disclaimer
This dataset may contain publicly available images or text data. All data is provided for research and educational purposes only. If you are the rights holder of any content and have concerns regarding intellectual property or copyright, please contact us at "support-data (at) jina.ai" for… See the full description on the dataset page: https://huggingface.co/datasets/jinaai/arxivqa_beir.synth_arxiv_ocrArxivQA
ArxivQA
ArxivQA is one of the 11 retrieval benchmarks used in RetrievalRouter: Joint Modality and
Architecture Selection for Document Retrieval (EMNLP 2026). Each record pairs a rendered page
image, a query, and the page's extracted text, supporting both text-based and multimodal
retrieval evaluation.
📄 Paper: https://arxiv.org/pdf/2608.25625
💻 Code: https://github.com/emrekuruu/retrieval-router
🤗 Collection: https://huggingface.co/collections/emrekuruu/retrieval-router… See the full description on the dataset page: https://huggingface.co/datasets/emrekuruu/ArxivQA.ArxivQAarx-basket-0726-v30This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "arx",
"total_episodes": 30,
"total_frames": 36018,
"total_tasks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path": "videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4",
"features": {… See the full description on the dataset page: https://huggingface.co/datasets/rdoshi21/arx-basket-0726-v30.SemanticSTF
📌 SemanticSTF Dataset
SemanticSTF is a real multimodal LiDAR dataset collected under adverse weather conditions including rain, snow, and fog, for autonomous driving research.
It provides synchronized LiDAR point clouds, RGB images, and per-point semantic labels of 20 classes, designed for 3D semantic segmentation and sensor fusion tasks.
The dataset contains train/val/test splits, camera intrinsics/extrinsics, and high-quality annotations aligned at the frame level.… See the full description on the dataset page: https://huggingface.co/datasets/AR-X/SemanticSTF.arxiv-ocr-v0.2-smallGeoMMBencharxiv-ocr-768px-55karx-cubeThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "arx",
"total_episodes": 28,
"total_frames": 11286,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:28"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/rdoshi21/arx-cube.ARX_X5_data_lerobot_merge_fixarxiv-chandra-ocr-2-include-images-first50-20260415
arXiv OCR with Chandra OCR 2
This output bundle stores OCR results for arXiv PDFs using datalab-to/chandra-ocr-2.
Summary
Output dataset: nielsr/arxiv-chandra-ocr-2-include-images-first50-20260415
Output bucket: hf://buckets/nielsr/arxiv-chandra-ocr-2-include-images-first50-20260415
Source paper IDs in input list: 27,584
Processed IDs recorded in state/processed_ids.txt: 50
Successes: 50
Partial successes: 0
Errors: 0
Next shard index: 10
Updated at:… See the full description on the dataset page: https://huggingface.co/datasets/nielsr/arxiv-chandra-ocr-2-include-images-first50-20260415.arxivqa_13659arxiv-ocr-v0.2Arxiv_AI_Research_Papersblue-arxiv-paperslatextract-arxiv-math
latextract-arxiv-math
A multi-domain corpus of (formula image, LaTeX source) pairs harvested from
arXiv source tarballs. Each formula is rendered in isolation with tectonic
into a tightly-cropped PNG; the ground-truth LaTeX is the body of the original
display-math environment, normalized to remove \label{...}.
Provenance
Source: arXiv e-print/<id> tarballs (publicly downloadable)
Renderer: tectonic (LaTeX engine) + MuPDF (PDF → PNG @ 200 DPI)
Filtering: papers using… See the full description on the dataset page: https://huggingface.co/datasets/tbrrss/latextract-arxiv-math.