Datasetpublic

ShayManor/Labeled-arXiv

Labeled-arXiv Enriched arXiv paper metadata and derived author bibliometrics sourced from OpenAlex. Contains 2.93M papers and 1.72M authors across all arXiv subject areas. Subsets papers — 2.93M rows Column Type Description id string arXiv paper ID (e.g. 0704.0028) submitter string (nullable) Name of the submitting author authors string Raw author string from arXiv metadata title string Paper title comments string (nullable)… See the full description on the dataset page: https://huggingface.co/datasets/ShayManor/Labeled-arXiv.

sourceHugging Facecc0-1.0updated 7mo agoView on Hugging Face

1likes112downloads

Dataset Card

Labeled-arXiv

Enriched arXiv paper metadata and derived author bibliometrics sourced from OpenAlex. Contains 2.93M papers and 1.72M authors across all arXiv subject areas.

Subsets

`papers` — 2.93M rows

Column	Type	Description
`id`	`string`	arXiv paper ID (e.g. `0704.0028`)
`submitter`	`string` (nullable)	Name of the submitting author
`authors`	`string`	Raw author string from arXiv metadata
`title`	`string`	Paper title
`comments`	`string` (nullable)	Submitter comments (page count, figures, etc.)
`journal-ref`	`string` (nullable)	Journal publication reference
`doi`	`string`	Digital Object Identifier
`report-no`	`string` (nullable)	Report number
`categories`	`string`	arXiv category tags (e.g. `math.CA math.PR`)
`license`	`string`	License identifier (9 distinct values)
`abstract`	`string`	Paper abstract
`versions`	`list`	Version history entries
`update_date`	`date32`	Date of last metadata update
`authors_parsed`	`list`	Structured author names (parsed into components)
`author_ids`	`list` (nullable)	OpenAlex/ORCID author IDs linked to this paper
`deleted`	`bool`	Whether the paper has been removed from arXiv
`citations`	`list` (nullable)	List of citing work identifiers
`citation_count`	`int32`	Number of citations (range: 0–30.5k)

`authors` — 1.72M rows

Author-level metrics derived from the papers in this dataset, not global totals.

Column	Type	Description
`author_id`	`string`	ORCID URL or OpenAlex ID
`name`	`string` (nullable)	Author display name
`paper_dois`	`list[string]`	DOIs of the author's papers in this dataset
`h_index`	`int32`	H-index computed within this dataset (0–84)
`works_count`	`int32`	Paper count within this dataset (1–13.9k)
`cited_by_count`	`int32`	Total citations within this dataset (0–57k)

Note: h_index, works_count, and cited_by_count are scoped to this dataset and do not represent an author's complete publication record.

Usage

python

from datasets import load_dataset

papers = load_dataset("ShayManor/Labeled-arXiv", "papers", split="train")
authors = load_dataset("ShayManor/Labeled-arXiv", "authors", split="train")

Source

Metadata from OpenAlex (Priem et al., 2022), built on top of the arXiv bulk metadata. Author IDs use ORCID URLs or OpenAlex internal identifiers.

License

CC0 1.0 — Public Domain.