reapxdev/crossref-scraper

Crossref Scraper · DOI Metadata, Authors, Journals & Citations

Scrape scholarly DOI metadata, works, journal articles, authors, citations, funding, and licenses from the Crossref REST API. Fast HTTP scraper with pay-per-event pricing.

What this is

Every row here was returned by a real run of a public collector. Nothing is generated from a template over a keyword list: a row exists because a run observed it.

A browsable presentation of the subset that carries an addressable doi is published as 2,492 entity pages at https://reapx.dev/data/crossref-scraper/, one page per entity. This dataset is the larger of the two — rows whose payload has no field that can address a page are here and are not published there.

Provenance

Each row carries _run_id and _dataset_id, naming the collector run that produced it, so any row can be traced back to the run that observed it. Rows observed by more than one run are deduplicated on content; 8 duplicate observations were collapsed.

Files

• —crossref-scraper.jsonl — one JSON object per row, the canonical form
• —crossref-scraper.csv — the same rows flattened; nested values are JSON-encoded within their cell so they round-trip
• —dataset.json — schema.org Dataset metadata

Loading it

from datasets import load_dataset
ds = load_dataset("reapxdev/crossref-scraper", split="train")

A sample of the published entities

• —The Concepts of Stress and Stress System Disorders
• —Coral bleaching, bleaching-induced mortality, and the adaptive significance of the bleaching response
• —10.1016/j.lana.2026.101529
• —Coral bleaching — capacity for acclimatization and adaptation
• —Self-efficacy: Toward a unifying theory of behavioral change.
• —Keep Calm and CRISPR On
• —Quadruped walking robot with multi PIC microcomputer system
• —Aqueous Sodium-Ion Battery As Post Lithium-Ion Battery
• —10.1242/bio.058812
• —Deep Chinese Teaching and Learning Model Based on Deep Learning
• —ENFRENTAR COM SOLIDARIEDADE À COVID-19
• —Taiwanese Students’ Understanding of Differences in History Textbook Accounts

Related

• —All sources: <https://reapx.dev/data/> · machine-readable index: <https://reapx.dev/llms.txt>
• —The collector is a public Apify Actor; agents reach it through <https://mcp.apify.com>

Licence

Collected from public sources. This metadata and the published pages are CC BY 4.0; the underlying records remain under the terms of their originating source.