Datasetpublic

demfier/reviewertoo-iclr2025

ICLR 2025 — Submissions, Reviews & Metareviews ICLR 2025 submissions with metadata, the program decision, reviewer ratings, the human peer-review/rebuttal discussion, and the human metareview. Sourced from OpenReview. Two configs: iclr2025_2k — the curated 1,962-paper evaluation subset used by ReviewerToo (the exact set behind Meta-all 83.4%). iclr2025_full — the full 11,672-paper ICLR 2025 submission pool. Decision breakdown iclr2025_2k iclr2025_full… See the full description on the dataset page: https://huggingface.co/datasets/demfier/reviewertoo-iclr2025.

sourceHugging Facecc-by-4.0updated 3mo agoView on Hugging Face

0likes333downloads

Dataset Card

ICLR 2025 — Submissions, Reviews & Metareviews

ICLR 2025 submissions with metadata, the program decision, reviewer ratings, the human peer-review/rebuttal discussion, and the human metareview. Sourced from OpenReview. Two configs:

—`iclr2025_2k` — the curated 1,962-paper evaluation subset used by ReviewerToo (the exact set behind Meta-all 83.4%).
—`iclr2025_full` — the full 11,672-paper ICLR 2025 submission pool.

Decision breakdown

	`iclr2025_2k`	`iclr2025_full`
Accept (Oral)	213	213
Accept (Spotlight)	379	380
Accept (Poster)	300	3,115
Reject	500	7,893
Withdrawn	500	—
Desk rejected	70	71
accept / reject	892 / 1,070	3,708 / 7,964

Reviews are present for 1,812 / 11,520 papers respectively; metareviews for 1,423 / 8,727 (rejected and withdrawn papers often have neither).

Fields

Both configs share one schema, one row per paper:

field	type	description
`paper_id`	string	OpenReview forum id
`year`	int	2025
`title`, `abstract`	string	submission title and abstract
`authors`, `author_ids`	string	author names and OpenReview ids
`keywords`	list[string]	author keywords
`primary_area`	string	ICLR primary area
`arxiv_id`	string	arXiv id when matched (else empty)
`citations_serper`	int	citation count at collection time (nullable)
`decision`	string	program decision (raw, lowercased)
`decision_binary`	string	`accept` / `reject`
`reviewer_scores`	list[int]	per-reviewer overall ratings
`num_reviewers`	int	number of review threads
`reviews`	string	human peer reviews and author rebuttals, flattened
`metareview`	string	human area-chair metareview

reviews holds the official reviews and the author/reviewer discussion; metareview holds the area chair's metareview on its own.

Collection

scrape_iclr2025.py (included) pulls the submissions, decisions, and discussion from the OpenReview API. Supply your own credentials via the OPENREVIEW_USERNAME and OPENREVIEW_PASSWORD environment variables.

Loading

python

from datasets import load_dataset
twok = load_dataset("demfier/reviewertoo-iclr2025-2k", "iclr2025_2k", split="train")
full = load_dataset("demfier/reviewertoo-iclr2025-2k", "iclr2025_full", split="train")

License

Content originates from OpenReview (ICLR 2025), released under CC BY 4.0.