datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
datacite-unique-affiliations
DataCite 2026-07 Exact Affiliation Usage
This dataset contains exact, case-sensitive affiliation strings from both
DataCite creators and contributors. Every placement contributes one occurrence
count; repeated placements on a DOI are retained. DOI count is distinct per
exact affiliation.
Contents
Distinct DataCite DOIs, including DOI records without affiliations: 132,801,254
Valid DOI source records (DOI stream rows): 132,801,303
Valid affiliation occurrences:… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-unique-affiliations.datacite-affiliations-matched-ror
DataCite Affiliations Matched to ROR
This dataset contains author affiliation data extracted from DataCite metadata records, matched against the Research Organization Registry (ROR).
Dataset Configurations
Configuration
Records
Size
doi_author_affiliations
158,351,335
36.01 GB
enriched_records
5,640,704
4.92 GB
ror_matches
731,798
134.62 MB
ror_matches_failed
654,780
91.80 MB
unique_affiliations
1,386,578
113.57 MB
existing_assignments
127,865,845… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-affiliations-matched-ror.datacite-rtg-text-other-reclassification
DataCite Resource Type Generic Reclassification Dataset
This dataset contains the results of reclassifying ~11.8 million DataCite metadata records that were originally classified as generic "Text" or "Other" resource types into more specific, granular categories using a LoRA fine-tuned Qwen2.5-7B model.
Dataset Details
Dataset Description
This dataset represents the output of applying the cometadata/generic-resource-type-lora-qwen2.5-7b model to reclassify… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-rtg-text-other-reclassification.crossref-datacite-citations
Crossref DataCite Citations
A dataset of DataCite-registered works and the Crossref-registered works that
cite them, extracted from Crossref reference metadata and confirmed against
the DataCite monthly data file.
Dataset Description
Each record in the citation configurations is one DataCite DOI together with
every confirmed citing work found in Crossref reference metadata. A reference
is confirmed when it carries a DOI registered in DataCite or an arXiv… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/crossref-datacite-citations.arxiv-software-repo-links-datacite-enrichment-format
arXiv Software Repository Links - DataCite Enrichment Format
A collection of metadata enrichments, formatted for DataCite's enrichment API, that add links between arXiv papers (via DOI) and the software repositories they reference or are supplemented by.
Quick Start
from datasets import load_dataset
ds = load_dataset("cometadata/arxiv-software-repo-links-datacite-enrichment-format")
Dataset Description
Each record is a DataCite-style enrichment instruction… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/arxiv-software-repo-links-datacite-enrichment-format.comet-datacite-enrichment-layer-ingest-format
COMET Enrichment Files - DataCite Enrichment Layer Ingest Format
This dataset contains metadata enrichment records in the DataCite enrichment ingest format, produced by the COMET (Collaborative Metadata) initiative. Each record represents a single metadata enrichment to be applied to an existing DataCite record, identified by DOI.
The enrichments were generated against the February 2026 version of the DataCite monthly data file using the datacite-enrichment tool.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/comet-datacite-enrichment-layer-ingest-format.datacite-affiliations-matched-ror-ids-datacite-enrichment-format
DataCite Author Affiliations Matched to ROR IDs - DataCite Enrichment Format
This dataset contains 20,512,320 enrichment records mapping author affiliation strings from DataCite metadata to Research Organization Registry (ROR) identifiers. It covers 5,812,774 unique DOIs from the DataCite Public Data File.
Each record is formatted as a DataCite enrichment input record, designed for use with the DataCite enrichment pipeline. Records use the updateChild action on the creators field… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-affiliations-matched-ror-ids-datacite-enrichment-format.2025-08-datacite-normalized-affiliation-string-distribution
DataCite Normalized Affiliation Distribution
Summary
normalized_distribution.json contains one JSON object per normalized affiliation string. It aggregates the total
occurrence count, a ranked list of the raw affiliation strings that collapse into the normalized form, and the
provider/client entities that asserted them. This dataset is derived from the August 2025 DataCite creator/contributor export.
Structure
{
"normalized": "example university"… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/2025-08-datacite-normalized-affiliation-string-distribution.2025-08-datacite-ror-identifier-dois
ROR Identifier DOI Distribution
Summary
ror_identifier_doi_distribution.json provides an inventory of every ROR (or ROR-formatted) identifier in the August 2025 DataCite data file. Each entry describes how many affiliation rows inlcude the identifier, the list
of unique DOIs, and which providers/clients asserted it.
Structure
{
"identifier": "https://ror.org/01abc1234",
"occurrences": 512,
"dois": ["10.1234/abc", "10.1234/xyz"],
"providers":… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/2025-08-datacite-ror-identifier-dois.datacite-funders-matched-ror-ids-datacite-enrichment-format
DataCite Funders Matched to ROR IDs - DataCite Enrichment Format
This dataset contains 1,008,697 enrichment records mapping funder name strings from DataCite metadata to Research Organization Registry (ROR) identifiers. It covers 697,791 unique DOIs from the DataCite Public Data File.
Each record is formatted as a DataCite enrichment input record, designed for use with the DataCite enrichment pipeline. Records use the updateChild action on the fundingReferences field, providing a… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-funders-matched-ror-ids-datacite-enrichment-format.2025-08-datacite-normalized-affiliation-dois
Normalized Affiliation DOI Distribution
Summary
normalized_affiliation_doi_distribution.json lists every normalized affiliation string alongside the DOIs where it
appears in the August 2025 DataCite data file. For each normalized token the file stores the occurrence count, the sorted DOI list (unique per token),
and provider/client frequency summaries.
Structure
{
"normalized": "example university",
"occurrences": 314,
"dois": ["10.1234/abc"… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/2025-08-datacite-normalized-affiliation-dois.datacite-rtg-text-other-reclassification-records-training-format2025-08-datacite-affiliation-assertions
DataCite Affiliation Assertions
Summary
This dataset packages three JSON arrays derived from the August 2025 DataCite data file:
affiliations_with_ror.json, affiliations_without_ror.json, and affiliation_overlap.json. Together they
capture the complete set of affiliation strings, their ROR identifier assignment patterns, and the overlap between
assigned and unassigned occurrences. Each record also reports the number of distinct providers and clients
asserting that… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/2025-08-datacite-affiliation-assertions.datacite-titles-descriptions-related-identifiers
DataCite Dataset Titles, Descriptions, and Related Identifiers
Structured extraction of titles, descriptions, and related identifiers for all records with resourceTypeGeneral: Dataset in the DataCite metadata corpus.
Source
Parsed from the 2026-03 DataCite Monthly Data File.
Contents
61,096,014 records (one row per DOI)
Filtered to resourceTypeGeneral: Dataset only
Single Parquet file with nested columns
Schema
Column
Type… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-titles-descriptions-related-identifiers.datacite-procedural-resource-type-general-reclassifications-datacite-enrichment-formatzenodo-software-datacite-recordsdatacite-rtg-text-other-reclassification-records
DataCite Resource Type General "Text/Other" Reclassification Records
Overview
This dataset contains DataCite metadata records that were originally classified with resourceTypeGeneral values of "Text" or "Other."
Dataset Structure
Each record is a JSON object containing the record:
{
"doi": "10.5281/zenodo.1234567",
"original_resource_type_general": "Text",
"reclassified_resource_type_general": "JournalArticle",
"title": "Example Research Article Title"… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-rtg-text-other-reclassification-records.datacite-procedural-resource-type-general-reclassifications
DataCite DOI Procedural Reclassifications
Overview
This dataset contains procedural reclassifications of DataCite DOIs where the resourceTypeGeneral field is either "Text" or "Other". The dataset maps these DOIs to more specific resourceTypeGeneral classifications based on fuzzy matching of the resourceType field against DataCite's controlled vocabulary for this field.
Dataset Structure
Each instance represents a DOI with its original and inferred resource… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/datacite-procedural-resource-type-general-reclassifications.arxiv-author-affiliation-parsing-sample-datacite-enrichment-format2025-08-datacite-affiliation-assertions-single-search-matched