population-integrity
genetics-population-transfer-integrity-v0.1What this dataset tests
Whether genetic findings survivetransfer from the discovery populationto a different target population.
Required outputs
discovery population
target population
transfer assumptions
transfer failures
clinical risk if applied
Typical failures
European PRS used globally
penetrance assumed invariant
tag SNPs treated as causal across ancestries
Suggested prompt wrapper
System
You enforce population transfer integrity in genetics.
You prevent unsafe… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/genetics-population-transfer-integrity-v0.1.clarus-population-framework-transition-integrity-v0.1Clarus Population Framework Transition Integrity v0.1
What this dataset tests
You track how the study population is defined as it moves across formal frameworks
You detect when inclusion, exclusion, or analysis sets change without explicit mapping
You flag population drift introduced between planning and reporting stages
Framework transitions covered
Trial registry → protocol
Protocol → statistical analysis plan
SAP → publication
Scope
One trial
Multiple population definitions
Multiple… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/clarus-population-framework-transition-integrity-v0.1.clarus-population-indication-integrity-v0.1.1Clarus Population and Indication Integrity v0.1.1
What this measures
You detect when a synthesis collapses patient context across trials
You must name the missing context in plain language
Task per row
Pick A or B
Write a short note that states the key context difference
Gold fields
correct_option is the decision label
required_keywords lists required note elements separated by "|"
Predictions file
CSV columns
sample_id
predicted_option
predicted_note
population-indication-integrity-v0.1Clarus Endpoint Definition Integrity v0.1
What this measures
You catch endpoint label reuse that hides a definition change
You track event rules, censoring, time origin, adjudication, scales, margins
What you do per row
Read trial_a_context and trial_b_context
Read the claim in the synthesis
Pick A or B
Predictions input
sample_id
predicted_option
population-boundary-integrity-v0.1What this dataset tests
Studied cohort versus claimed population.
It detects generalization creep.
It flags inference beyond enrollment criteria.
Required outputs
cohort_profile
claimed_population_profile
boundary_violations
required_population_disambiguation
risk_if_overgeneralized
Typical failures
assuming age or comorbidity transfer
extending findings to excluded groups
conflating inpatient evidence with outpatient claims
Suggested prompt wrapper
System
You check… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/population-boundary-integrity-v0.1.clinical-population-boundary-integrity-v0.1What this dataset tests
Whether clinical claims stay withinthe population actually studied.
Required outputs
studied population
claimed population
boundary violations
safety risk of overreach
Typical failures
adult data applied to children
fit trial populations applied to frail patients
disease subtype expansion without evidence
Suggested prompt wrapper
System
You enforce population boundaries.
You prevent unsafe generalization.
User
Studied… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/clinical-population-boundary-integrity-v0.1.