consistency-training
factual-consistency-training-mixThis is a mix of NLI-like datasets that is used to train factual consistency models available in this collection.
Some of the datasets are upsampled here (Seahorse). In all cases, we upsample the less represented label since we want to use this dataset for a binary classification task.
The distribution of the dataset is as follows:
subset
count
alisawuffles/WANLI
127885
anli
105076
Seahorse
31666
LingNLI
19994
scitail
16944
boolq
11725
FoolMeTwice
10569
vitaminc
8489… See the full description on the dataset page: https://huggingface.co/datasets/ragarwal/factual-consistency-training-mix.prompt_consistency_training_fewer
🚀 Load Dataset
from datasets import load_dataset
dataset = load_dataset("shuyuej/prompt_consistency_training_fewer")
dataset = dataset["train"]
print(dataset)
prompt_consistency_training_full_data
🚀 Load Dataset
from datasets import load_dataset
dataset = load_dataset("shuyuej/prompt_consistency_training_full_data")
dataset = dataset["train"]
print(dataset)
prompt_consistency_training
🚀 Load Dataset
from datasets import load_dataset
dataset = load_dataset("shuyuej/prompt_consistency_training")
dataset = dataset["train"]
print(dataset)