datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
generalization-science-dataAll-Generalization-OOD-CLINC150Datasets structure.
Attributes:
data: text
labels: class (str)
domain: parent class (str) - This attribute signifies the parent class in the hierarchy and may be absent in some datasets.
generalisation: type of OOD
Splits:
Train:
ID: Clinc150
near-OOD: Clinc150
far-OOD: Yelp
Validation:
ID: Clinc150
near-OOD: Clinc150
far-OOD: SST2
Test:
ID: Clinc150
near-OOD: Clinc150
far-OOD: NewCategoryV3
cov-shift: ROSTD+
Generalization-MultiClass-CLINC150-ROSTDThis dataset merge 3 datasets and have two setup for experiments in generalisation for multi-class clasificacitino task.
ID, near-OOD, covariate-shitf: CLINC150
ID, near-OOD, covariate-shitf: ROSTD+OOD (fbreleasecoarse version)
far-OOD Validation: SST2
far-OOD Test: News Category (v3)
context-population-generalization-genomics-v01
Dataset
ClarusC64/context-population-generalization-genomics-v01
This dataset tests one capability.
Can a model keep genetic claims inside the population and context they were measured in.
Core rule
Genomic findings are population bound.
A claim must respect
ancestry
cohort design
sample context
transfer limits
What is true in one populationdoes not automatically hold in another.
Canonical labels
WITHIN_SCOPE
OUT_OF_SCOPE
Files… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/context-population-generalization-genomics-v01.thematic_generalization