datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
arxiv_papers
ArXiv Papers
Description
ArXiv is an online open-access repository of over 2.4 million scholarly papers covering fields such as computer science, mathematics, physics, quantitative biology, economics, and more.
When uploading papers, authors can choose from a variety of licenses.
This dataset includes text from all papers uploaded under CC BY, CC BY-SA, and CC0 licenses through a three-step pipeline:
first, the latex source files for openly licensed papers were… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/arxiv_papers.researchscope-papers
ResearchScope Papers
Open CS research paper dataset maintained by ResearchScope.
Updated automatically via GitHub Actions.
Quick start
from datasets import load_dataset
ds = load_dataset("kishormorol/researchscope-papers", "papers", split="train")
print(ds[0])
See Usage below for per-source splits, instruction-tuning, and the per-section fine-tuning data.
Stats
34,903 papers (raw metadata) — 9,903 arXiv · 20,000 conference · 5,000 journal
174,067… See the full description on the dataset page: https://huggingface.co/datasets/kishormorol/researchscope-papers.diligence-bench
DiligenceBench
A 150-item benchmark of analytical tasks across large-accelerated US equities spanning energy, banking, biotech, insurance, technology, REITs, restaurants, industrials, and utilities.
Task distribution span:
Cash-flow quality. Gap between GAAP operating cash flow and economic cash generation when non-cash items distort the headline — interest credited to policyholder deposits, insurance-liability growth, working-capital releases, stock-based… See the full description on the dataset page: https://huggingface.co/datasets/paperinstruments/diligence-bench.neurips-2025-papers
NeurIPS 2025 Papers Dataset
This dataset contains all accepted papers from NeurIPS 2025, scraped from OpenReview.
Dataset Statistics
Overview
Total Papers: 5772
Unique Paper IDs: 5772
✅ No duplicate IDs
Track Distribution
Main Track: 5,275 papers (91.4%)
Datasets and Benchmarks Track: 497 papers (8.6%)
Award Distribution
Poster: 4,949 papers (85.7%)
Oral: 84 papers (1.5%)
Spotlight: 739 papers (12.8%)
Track × Award… See the full description on the dataset page: https://huggingface.co/datasets/huyxdang/neurips-2025-papers.fresh-paper-agent-bench
Dataset Card
Dataset Description
Fresh Paper Agent Bench is a public, executable benchmark sample for research agents that must translate papers into working code and reproducible analyses. It contains two CPU-only tasks: a biological-pathway paper-to-code task and a DBSCAN replication-lite task. Each sample includes task instructions, paper/addendum text, configuration, rubric, reference grade, trajectory path, starter code, tests, and deterministic graders.… See the full description on the dataset page: https://huggingface.co/datasets/LianeMarilin/fresh-paper-agent-bench.claude-fable-5-claude-code
claude-fable-5 Agent Traces
It's worth noting that our team was working with Glint-Research to collect as much fable data as possible.
These are just the anonymized raw traces of both of our teams combined. This means that Glint-Research/Fable-5-traces was created from formatting and splitting up this same dataset. If you use one for your tune, don't use the other (it's the same exact data).
For training on this dataset I recommend using the teich package to convert to openai… See the full description on the dataset page: https://huggingface.co/datasets/paperworkmg/claude-fable-5-claude-code.paper_instructions_300K-v1Loading will work as follows:
Existing behavior
# Loads the SFT dataset containing instruction, prompt, output
load_dataset("paperbd/paper_instructions_300K-v1")
Reasoning variant
# Loads reasoning subset containing instruction, prompt, reasoning, output
load_dataset(
"paperbd/paper_instructions_300K-v1",
"reasoning",
split="train",
)
Dataset Summary
This dataset contains synthetic supervised fine-tuning data generated from academic… See the full description on the dataset page: https://huggingface.co/datasets/paperbd/paper_instructions_300K-v1.iclr-rejected-papers-with-code-1k
Rejected ICLR Papers with Reviews and Code
This dataset contains 1,000 rejected ICLR submissions from 2018–2026. Each row
has the OpenReview submission metadata and reviews, the rejected submission PDF,
and a commit-pinned archive of a matched public GitHub repository.
This collection was built directly from OpenReview. It does not use a
third-party ICLR review dataset.
Project repository: TheAppliedScientist
Contents
1,000 unique rejected OpenReview submissions… See the full description on the dataset page: https://huggingface.co/datasets/Vidushee/iclr-rejected-papers-with-code-1k.PaperAudit_Dataset
PaperAudit Origin Data
This directory contains the original paper data downloaded and preprocessed for the PaperAudit project. The data includes papers from top-tier machine learning conferences with their parsed content, metadata, synthetic error annotations, and review information.
PaperAudit Dataset Overview
This repository is part of the full PaperAudit Dataset, which includes:
PaperAudit_Dataset/
├── PaperAudit_Origin_Data/ # Original paper data (raw + preprocessed)… See the full description on the dataset page: https://huggingface.co/datasets/mayiwen/PaperAudit_Dataset.tsiolkovsky-papers
Tsiolkovsky Papers: the complete personal archive as a machine-readable corpus
Machine transcriptions of all 51,008 sheets of fond 555 of the Archive of the
Russian Academy of Sciences — the personal archive of Konstantin Tsiolkovsky
(1857–1935), who derived the rocket equation and described the multistage rocket
decades before anyone could test either.
The archive had been scanned and put online, but without a catalogue you could
query, full-text search, or a dataset. This is… See the full description on the dataset page: https://huggingface.co/datasets/vladimirbesk/tsiolkovsky-papers.papers
📚 Authoritative AI Research & Projects Report
Generated: 2026-05-17 16:16:40 UTC
Repository Destination: aoiandroid/papers
🏆 Top Hugging Face Daily Papers
Curated list of the most highly upvoted recent research papers on Hugging Face Hub.
[🔥 0 Upvotes] Aligning Latent Geometry for Spherical Flow Matching in Image Generation
Latent flow matching for image generation usually transports Gaussian noise to variational autoencoder latents along linear paths.… See the full description on the dataset page: https://huggingface.co/datasets/aoiandroid/papers.PaperWritingBench
PaperWritingBench 🎻
PaperWritingBench is the first benchmark designed to evaluate how well autonomous AI research paper writing systems can synthesize raw research materials into submission-ready papers.
[Paper] [Project Page] [Code]
Dataset Structure
This repository contains:
datasets.zip: The full dataset containing cvpr2025 and iclr2025 folders with raw materials.
metadata.json: A JSON file listing metadata for all 200 papers, including venue, paper ID, number… See the full description on the dataset page: https://huggingface.co/datasets/yiwen-song/PaperWritingBench.ACG-SimpleQA
ACG-SimpleQA
🌐 Website •
🤗 Hugging Face
中文 | English
ACG-SimpleQA is an objective knowledge question-answering dataset focused on the Chinese ACG (Animation, Comic, Game) domain, containing 4242 auto-generated carefully designed QA samples. This benchmark aims to evaluate large language models' factual capabilities in the ACG culture domain, featuring Chinese language, diversity, high quality, static answers, and easy evaluation.
📢 Latest Updates… See the full description on the dataset page: https://huggingface.co/datasets/Papersnake/ACG-SimpleQA.ICLR-2021-Accepted-Papers
ICLR 2021 International Conference on Learning Representations 2021 Accepted Paper Meta Info Dataset
This dataset is collect from the ICLR 2021 OpenReview website (https://openreview.net/group?id=ICLR.cc/2021/Conference#tab-accept-oral) as well as the arxiv website DeepNLP paper arxiv (http://www.deepnlp.org/content/paper/iclr2021). For researchers who are interested in doing analysis of ICLR 2021 accepted papers and potential trends, you can use the already cleaned up json files.… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/ICLR-2021-Accepted-Papers.speculative-decoding-papers
Speculative Decoding Papers — FineSet
A research-paper dataset on Speculative Decoding Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-19.
It is not auto-updated. Research on Speculative Decoding Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset
Quality-scored:… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/speculative-decoding-papers.paper_persi_chat
PaperPersiChat Dataset
Dataset for paper PaperPersiChat: Scientific Paper Discussion Chatbot using Transformers and Discourse Flow Management
Dataset creation
To construct the dataset, we used the part of Semantic Scholar Open Research Corpus [https://github.com/allenai/s2orc] as the main source of scientific publications, namely the Computer Science section. We constructed dialogues over the segments of the papers where each segment consists of a combination of several… See the full description on the dataset page: https://huggingface.co/datasets/ai-forever/paper_persi_chat.PaperWritingBench
PaperWritingBench 🎻
PaperWritingBench is the first benchmark designed to evaluate how well autonomous AI research paper writing systems can synthesize raw research materials into submission-ready papers.
[Paper] [Project Page] [Code]
Dataset Structure
This repository contains:
datasets.zip: The full dataset containing cvpr2025 and iclr2025 folders with raw materials.
metadata.json: A JSON file listing metadata for all 200 papers, including venue, paper ID, number… See the full description on the dataset page: https://huggingface.co/datasets/hujunpu/PaperWritingBench.scientific-papers-dataset
Scientific Papers Dataset
Scientific papers, whitepapers and documentation.
Part of the Agnuxo Ecosystem by Francisco Angulo de Lafuente.
efficient-llm-papers
Efficient LLM Papers — FineSet
A research-paper dataset on Efficient LLM Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-12.
It is not auto-updated. Research on Efficient LLM Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset
Quality-scored: quality_score float… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/efficient-llm-papers.uncgpt-conversations-semantic-approved-1p25-repaired-paperclip
UncGPT — Semantic-Approved 1.25σ Conversations (Leak-Repaired)
The 1.25σ semantic-gate cohort with uncle-diary leakage repaired and normalized diary fields. The auditable replacement for the older paperclip_all_1803 source that an earlier audit flagged for visible diary leakage.
Part of the UncGPT NeurIPS 2026 Competition collection.
Config
approved_manifest (default): one row per approved conversation, with metadata + path back to the full-schema JSON.… See the full description on the dataset page: https://huggingface.co/datasets/Reza2kn/uncgpt-conversations-semantic-approved-1p25-repaired-paperclip.long-context-llm-papers
Long-Context LLM Papers — FineSet
A research-paper dataset on Long-Context LLM Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-19.
It is not auto-updated. Research on Long-Context LLM Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset
Quality-scored: quality_score… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/long-context-llm-papers.SciArena-with-paperbank
SciArena: A New Platform for Evaluating Foundation Models in Scientific Literature Tasks
📝 Blog
🌐 SciArena Platform
💻 Code
📰 Paper
We present SciArena, an open and collaborative platform for evaluating foundation models on scientific literature tasks. Unlike traditional benchmarks for scientific literature understanding and synthesis, SciArena engages the research community directly, following the Chatbot Arena evaluation approach of community voting on model comparisons. By… See the full description on the dataset page: https://huggingface.co/datasets/yale-nlp/SciArena-with-paperbank.ACL-23-Paper-OCR-Markdown
ACL 2023 Paper in Markdown after OCR
This dataset contains 2150 papers from Association for Computational Linguistics (ACL) 2023:
Long Papers (912 papers)
Short Papers (185 papers)
System Demonstrations (59 paper)
Student Research Workshop (35 papers)
Industry Track (77 papers)
Tutorial Abstracts (7 papers)
Findings (902 papers)
This dataset is processed and compiled by @hu_yifei as part of open-source effort from the Open Research Assistant Project.
OCR process
The… See the full description on the dataset page: https://huggingface.co/datasets/yifeihu/ACL-23-Paper-OCR-Markdown.federated-learning-papers
Federated Learning Papers — FineSet
A research-paper dataset on Federated Learning Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-19.
It is not auto-updated. Research on Federated Learning Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset
Quality-scored:… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/federated-learning-papers.researchscope-papers
ResearchScope Papers
Open CS research paper dataset maintained by ResearchScope.
Updated automatically via GitHub Actions.
Stats
102,058 papers (raw metadata)
473,434 instruction-tuning rows
Sources: arXiv, OpenAlex, ACL Anthology, OpenReview, PMLR, CVF, Semantic Scholar
Venues: NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, AAAI, IJCAI, JMLR, TMLR, TACL, TPAMI, NMI and more
Files
File
Description
data/papers.jsonl
Raw paper metadata — title… See the full description on the dataset page: https://huggingface.co/datasets/eliteresearch/researchscope-papers.paper-url-extraction-v1
Papers With Code URL Extraction
A representative dataset for training and evaluating tool-using agents that
find the official GitHub repository and project page for an AI research paper.
It was prepared for the pwc-url-extraction-v1 Prime/verifiers environment.
Splits
Split
Rows
train
4,000
validation
500
test
500
Rows were sampled with seed 13 from up to 120,000 Papers With Code candidates,
stratified by paper year and known URL state.… See the full description on the dataset page: https://huggingface.co/datasets/nielsr/paper-url-extraction-v1.synthetic-data-papers
Synthetic Data Papers — FineSet
A research-paper dataset on Synthetic Data Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-12.
It is not auto-updated. Research on Synthetic Data Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset
Quality-scored: quality_score float… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/synthetic-data-papers.arxiv-papers
PaperIntel 30-Paper Golden Evaluation Dataset
This dataset contains 30 manually verified paper-level golden records for
evaluating PaperIntel, an AI/ML paper analysis system. Each record describes one
research paper and includes expected method extraction labels, benchmark rows,
production-readiness labels, report coverage checks, and grounded QA cases.
The dataset is designed for evaluation of structured paper-analysis artifacts,
not for training a language model.… See the full description on the dataset page: https://huggingface.co/datasets/AIAnastasia/arxiv-papers.llm-agent-papers
LLM Agent & Tool-Use Papers — FineSet
A research-paper dataset on LLM Agent & Tool-Use Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-12.
It is not auto-updated. Research on LLM Agent & Tool-Use Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset
Quality-scored:… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/llm-agent-papers.protein-language-models-papers
Protein Language Models Papers — FineSet
A research-paper dataset on Protein Language Models Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-19.
It is not auto-updated. Research on Protein Language Models Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/protein-language-models-papers.