CoolFace
Datasetpublic

RubyIntelligence/clinicaltrials-completed-phase3

clinicaltrials-completed-phase3-full — Data Card Version: 1.1.0 | Generated: 2026-06-14T06:18:47.568731+00:00 | Records: 29,633 Dataset Summary clinicaltrials-completed-phase3-full contains structured clinical trial records from ClinicalTrials.gov, the U.S. federal registry of clinical studies operated by the National Library of Medicine (NIH). Each record includes trial status, design parameters, eligibility criteria, sponsor information, enrollment counts, and… See the full description on the dataset page: https://huggingface.co/datasets/RubyIntelligence/clinicaltrials-completed-phase3.

sourceHugging Facecc-by-4.0updated 3mo agoView on Hugging Face
1likes48downloads
Dataset Card

clinicaltrials-completed-phase3-full — Data Card

Version: 1.1.0 | Generated: 2026-06-14T06:18:47.568731+00:00 | Records: 29,633

Dataset Summary

clinicaltrials-completed-phase3-full contains structured clinical trial records from ClinicalTrials.gov, the U.S. federal registry of clinical studies operated by the National Library of Medicine (NIH). Each record includes trial status, design parameters, eligibility criteria, sponsor information, enrollment counts, and primary outcome measures — extracted, normalized, and validated by the jade pipeline. Intended for clinical researchers, pharmaceutical data teams, market intelligence analysts, and quantitative healthcare investors.

Source

  • Primary source: ClinicalTrials.gov, the U.S. National Library of Medicine's registry of clinical studies, operated by NIH. Accessed via the ClinicalTrials.gov REST API v2. Enrichment fields added post-hoc from the same source.
  • Collection method: Automated pipeline using jade v0.1.0
  • License: U.S. Government Open Data (Public Domain) — no restrictions on use or redistribution
  • PII status: No personally identifiable information. Investigator contacts and patient-level data excluded at collection time.

Quality Metrics

  • Dataset quality score: 0.9867 (threshold: 0.92)
  • Validation layers: Pydantic schema · Business rules · Statistical checks · LLM cross-check
  • Records passing validation: 29,633 of 29,633 in this version

Field Definitions

FieldTypeDescription
nct_idstrClinicalTrials.gov unique identifier (NCT######)
titlestrBrief title of the clinical study
official_titlestrNoneFull official title of the study
statusstrOverall recruitment status (e.g. COMPLETED, RECRUITING)
start_datestrNoneStudy start date (YYYY-MM-DD)
completion_datestrNonePrimary completion date (YYYY-MM-DD)
sponsor_namestrLead sponsor organization name
sponsor_classstrNoneSponsor classification (INDUSTRY, NIH, OTHER_GOV, etc.)
conditionslist[str]Medical conditions or diseases studied
study_typestrNoneStudy type: INTERVENTIONAL or OBSERVATIONAL
phaseslist[str]Clinical trial phases (e.g. PHASE3)
enrollmentintNoneTarget or actual enrollment count
allocationstrNoneAllocation method: RANDOMIZED or NON_RANDOMIZED
maskingstrNoneBlinding type (e.g. DOUBLE, OPEN_LABEL)
interventionslist[dict]Interventions with type, name, and description
primary_outcomeslist[dict]Primary outcome measures with measure and time_frame
secondary_outcomeslist[dict]Secondary outcome measures with measure and time_frame
minimum_agestrdictNoneMinimum participant age (parsed value and unit)
maximum_agestrdictNoneMaximum participant age (parsed value and unit)
sexstrNoneEligible sex: ALL, FEMALE, or MALE
results_availableboolWhether results have been posted to ClinicalTrials.gov
locations_countintNoneNumber of study sites / locations
countrieslist[str]Countries where the study is conducted
trialdurationdaysintNoneDays from startdate to completiondate. Null if either date missing.
therapeutic_areastrDisease area classification: Oncology, Cardiovascular, Neurology / CNS, Infectious Disease, Metabolic / Endocrine, Immunology / Rheumatology, Respiratory, Gastroenterology, Dermatology, Ophthalmology, Rare Disease / Orphan, Other.
primaryendpointmetstrWhether the primary endpoint was achieved: 'true', 'false', or 'unknown'. Coverage: ~45% of records (those with posted results on ClinicalTrials.gov). Extracted by LLM from the results section.

Known Limitations

  • Location data (countries, locations_count) is absent for approximately 15% of studies where ClinicalTrials.gov omits the contactsLocationsModule.
  • sponsor_class may include values outside the standard set (e.g. 'OTHER') for a small fraction of records; these receive a statistical soft warning but are not excluded.
  • Completion dates reflect the study's reported anticipated or actual completion, not verified outcomes.
  • Age fields (minimumage, maximumage) are returned as parsed {value, unit} objects rather than plain strings.
  • primaryendpointmet is 'unknown' for ~55% of records where ClinicalTrials.gov has not yet posted results. This is expected — results are posted voluntarily and often lag trial completion.
  • therapeutic_area is LLM-assigned and may differ from formal MeSH classification for trials spanning multiple disease areas.

Update Cadence

Weekly (every Friday night)

Provenance

All records include a provenance object documenting:

  • Source URL and retrieval timestamp
  • Extraction model and pipeline version
  • Validation model and quality score
  • Whether LLM cross-check was performed

License

This dataset is derived entirely from U.S. federal government public records (ClinicalTrials.gov, operated by the National Library of Medicine, NIH). The source data is in the public domain. This structured, cleaned version is provided under CC BY 4.0 — attribution required.

How to Access the Full Dataset

The 50-row sample.csv in this repository is free to use under CC BY 4.0.

Full dataset (29,633 records, 26 fields, Parquet format): Available for purchase at Ruby Intelligence on Gumroad

  • One-time download: $1,499

Generated by jade pipeline v0.1.0 · 2026-06-14T06:18:47.568731+00:00