datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
clinc150Generalization-MultiClass-CLINC150-ROSTDThis dataset merge 3 datasets and have two setup for experiments in generalisation for multi-class clasificacitino task.
ID, near-OOD, covariate-shitf: CLINC150
ID, near-OOD, covariate-shitf: ROSTD+OOD (fbreleasecoarse version)
far-OOD Validation: SST2
far-OOD Test: News Category (v3)
All-Generalization-OOD-CLINC150Datasets structure.
Attributes:
data: text
labels: class (str)
domain: parent class (str) - This attribute signifies the parent class in the hierarchy and may be absent in some datasets.
generalisation: type of OOD
Splits:
Train:
ID: Clinc150
near-OOD: Clinc150
far-OOD: Yelp
Validation:
ID: Clinc150
near-OOD: Clinc150
far-OOD: SST2
Test:
ID: Clinc150
near-OOD: Clinc150
far-OOD: NewCategoryV3
cov-shift: ROSTD+