academic-paper-surgical-edit/academic-papers-dataset
๐ Academic Papers Dataset This dataset accompanies the paper: Evaluating LLM Judgment via Surgical Edits ๐ Dataset Summary The Academic Papers Dataset contains structured, parsed scientific papers from: ICLR โ 2024, 2025 ICML โ 2024, 2025 NeurIPS โ 2021, 2022, 2023, 2024 The dataset provides each paper in a standardized Markdown format, along with extracted figures. ๐ Dataset Statistics Conference Paper Countsโฆ See the full description on the dataset page: https://huggingface.co/datasets/academic-paper-surgical-edit/academic-papers-dataset.
๐ Academic Papers Dataset
This dataset accompanies the paper:
Evaluating LLM Judgment via Surgical Edits
๐ Dataset Summary
The Academic Papers Dataset contains structured, parsed scientific papers from:
- ICLR โ 2024, 2025
- ICML โ 2024, 2025
- NeurIPS โ 2021, 2022, 2023, 2024
The dataset provides each paper in a standardized Markdown format, along with extracted figures.
๐ Dataset Statistics
Conference Paper Counts
Total accepted (submitted): 24,426 Total accepted (parsed): 8,588 Total rejected (submitted): 1,922 Total rejected (parsed): 9,023
Note: The paper submission counts for each conference were obtained using the publicly available statistics from PaperCopilot (https://papercopilot.com/).
๐ Languages
- English (en) (Official conference submissions from ICLR, ICML, NeurIPS)
๐ How to Use This Dataset
Because the dataset contains large ZIP archives and thousands of structured papers, we recommend using git-xet for efficient cloning and storage.
1๏ธโฃ Install git-xet
git-xet enables fast and storage-efficient checkout of large files from Hugging Face Datasets.
Official docs: https://hf.co/docs/hub/git-xet
If you're on macOS:
brew install git-xet
git xet installLinux:
curl https://gitxet.com/install.sh | sudo bash
git xet install2๏ธโฃ Clone the dataset repository
git clone https://huggingface.co/datasets/academic-paper-surgical-edit/academic-papers-datasetThis will download lightweight file pointers first, and git-xet will fetch the large paper archives on demand.
๐ Dataset Structure
Inside the cloned repo, you will find per-conference ZIP files:
To extract:
unzip {ConferenceName}.zip -d {ConferenceName}/After extraction, you will see:
content/
โโโ parsed_arxiv/
โโโ {ConferenceName}/
โโโ accepted/
โโโ structured_paper_output/
โโโ paper.md
โโโ figures/
โ โโโ fig1.png
โ โโโ fig2.png
โ โโโ ...
โโโ rejected/
โโโ structured_paper_output/
โโโ paper.md
โโโ figures/
โ โโโ fig1.png
โ โโโ fig2.png
โ โโโ ...File Descriptions
๐ Citation
TBA
