cometadata/arxiv-software-repo-links-datacite-enrichment-format

arXiv Software Repository Links - DataCite Enrichment Format

A collection of metadata enrichments, formatted for DataCite's enrichment API, that add links between arXiv papers (via DOI) and the software repositories they reference or are supplemented by.

Quick Start

from datasets import load_dataset

ds = load_dataset("cometadata/arxiv-software-repo-links-datacite-enrichment-format")

Dataset Description

Each record is a DataCite-style enrichment instruction that inserts a relatedIdentifiers entry on an arXiv DOI, pointing to a software repository URL. The link set is derived from cometadata/arxiv-software-repo-links, reshaped into the structure expected by the DataCite metadata enrichment workflow.

Schema

{
  "doi": "10.48550/arxiv.0804.3853",
  "contributors": [
    {
      "name": "COMET Project",
      "contributorType": "Producer",
      "nameType": "Organizational"
    }
  ],
  "resources": [
    {
      "relatedIdentifier": null,
      "relatedIdentifierType": "DOI",
      "relationType": "IsDescribedBy",
      "resourceTypeGeneral": "Workflow"
    }
  ],
  "field": "relatedIdentifiers",
  "action": "insert",
  "enrichedValue": {
    "relatedIdentifier": "https://cran.r-project.org/package=bspec",
    "relatedIdentifierType": "URL",
    "relationType": "References"
  }
}

Fields

Dataset Statistics

Relationship Types

Methodology

This dataset was produced using extract-link-arxiv-software-repos.

1. 1.Software repository URLs are extracted from arXiv paper full-texts using pattern matching
2. 2.URLs are then validated via git ls-remote, API checks, and HTTP verification
3. 3.Generic "References" relationships (default association between the repo link and work) are promoted to "IsSupplementedBy" when evidence suggests the repository directly supports the paper, based on:
4. 4.arXiv ID present in repository README or description
5. 5.Repository name similarity to paper title
6. 6.Author matching: Repository contributors matched to paper authors using the evamxb/dev-author-em-clf model from sci-soft-models
7. 7.Validated links reshaped into DataCite enrichment records (action: insert, field: relatedIdentifiers) for use with the DataCite metadata enrichment workflow.

License

CC0 1.0 Universal (Public Domain)

Citation

@dataset{arxiv_software_repo_links_datacite_enrichment,
  title={arXiv Software Repository Links — DataCite Enrichment Format},
  author={COMET Project},
  year={2026},
  publisher={Hugging Face},
  url={https://huggingface.co/datasets/cometadata/arxiv-software-repo-links-datacite-enrichment-format}
}