datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
mnli
Glue MNLI
This dataset is a port of the official mnli dataset on the Hub.
It contains the matched version.
Note that the premise and hypothesis columns have been renamed to text1 and text2 respectively.
Also, the test split is not labeled; the label column values are always -1.
chaos-mnli-ambiguityChaos NLI MNLI portion with gini coefficient pre-computed (from 0 to 1)
High gini means unambiguous inference.
@inproceedings{xzhou2022distnli,
Author = {Xiang Zhou and Yixin Nie and Mohit Bansal},
Booktitle = {Findings of the Association for Computational Linguistics: ACL 2022},
Publisher = {Association for Computational Linguistics},
Title = {Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning},
Year = {2022}
}
glue-mnli-trainmnli_mm
Glue MNLI
This dataset is a port of the official mnli dataset on the Hub.
It contains the mismatched version.
Note that the premise and hypothesis columns have been renamed to text1 and text2 respectively.
Also, the test split is not labeled; the label column values are always -1.
glue_mnli_promptsourceMULTI_VALUE_mnli_indefinite_for_zero
Dataset Card for "MULTI_VALUE_mnli_indefinite_for_zero"
More Information needed
kaggle_mnli
Dataset Card for [Kaggle MNLI]
Dataset Summary
[These are the datasets posted to Kaggle for an inference detection NLP competition. Moving them here to use with Pytorch.]
Supported Tasks and Leaderboards
Provides train and validation data for sentence pairs with inference labels.
[https://www.kaggle.com/competitions/multinli-matched-open-evaluation/leaderboard]
[https://www.kaggle.com/competitions/multinli-mismatched-open-evaluation/leaderboard]… See the full description on the dataset page: https://huggingface.co/datasets/chrishuber/kaggle_mnli.nu-mnli
Translation Code
We used vLLM for a faster, batched generation.
import datasets as ds
from vllm import LLM, SamplingParams, RequestOutput
from transformers import AutoTokenizer
model_path = "hoge/fuga"
dataset: ds.Dataset = ds.load_dataset("nyu-mll/multi_nli", split="train")
dataset = dataset.select_columns(["premise", "hypothesis", "label", "genre"])
llm = LLM(
model=model_path,
quantization=None,
dtype="bfloat16",
tensor_parallel_size=4,
enforce_eager=True… See the full description on the dataset page: https://huggingface.co/datasets/cl-nagoya/nu-mnli.task202_mnli_contradiction_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task202_mnli_contradiction_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task202_mnli_contradiction_classification.mnli_anli_fevernli_wanli_lingnli_xnli_train
Dataset Card for "mnli_anli_fevernli_wanli_lingnli_xnli_train"
Train data in a harmonized format for multiple NLI datasets.
mnliGLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.mnli_resampled_as_mednli
Dataset Card for Dataset Name
This dataset inherits from mnli, and the only changes is to downsample to the same size as mednli. It is created via
with open("/path/to/mednli/mli_train_v1.jsonl") as f:
data = [json.loads(line) for line in f.readlines()]
raw_datasets = load_dataset("glue", "mnli")
raw_datasets["train"] = raw_datasets["train"].shuffle(seed=42).select(range(len(data)))
raw_datasets.push_to_hub("cnut1648/mnli_resampled_as_mednli")
mnli_corpus_valtrainMULTI_VALUE_mnli_zero_plural
Dataset Card for "MULTI_VALUE_mnli_zero_plural"
More Information needed
mnli-amr
Dataset Card for "mnli-amr"
More Information needed
mnli-mock-contrastive-axes-ii
Dataset Card for "mnli-mock-contrastive-axes-ii"
More Information needed
task201_mnli_neutral_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task201_mnli_neutral_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task201_mnli_neutral_classification.mnli-mock-contrastive-axes
Dataset Card for "mnli-mock-contrastive-axes"
More Information needed
glue_mnli_matched_promptsourcellama3-ultrafeedback-bertscore-bart-large-mnli
RefAlign: LLM Alignment Dataset
This dataset is used in the paper Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data.
Code: https://github.com/mzhaoshuai/RefAlign
This dataset is modified from https://huggingface.co/datasets/princeton-nlp/llama3-ultrafeedback. We use the BERTScore to choose the chosen and rejected responses.
Item with key ['Llama3.3-70B-Inst-Awq'] is the reference answers generated by… See the full description on the dataset page: https://huggingface.co/datasets/mzhaoshuai/llama3-ultrafeedback-bertscore-bart-large-mnli.neuronovo-utc-data-glue-mnlimnli-nineeleven-fr
Dataset Card for Dataset Name
Dataset Summary
This repository contains a machine-translated French version of the portion of MultiNLI concerning the 9/11 terrorist attacks (2000 examples).
Note that these 2000 examples included in MultiNLI (and machine translated in French here) on the subject of 9/11 are different from the 249 examples in the validation subset and the 501 ones in the test subset of XNLI on the same subject.
In the original subset of MultiNLI on 9/11, 26… See the full description on the dataset page: https://huggingface.co/datasets/maximoss/mnli-nineeleven-fr.seq2seq-mnli
Dataset Card for "seq2seq-mnli"
More Information needed
glue_augmented_mnli
Dataset Card for glue_augmented_mnli
Dataset Description
Augmented MNLI dataset
Reference: https://huggingface.co/datasets/glue
MNLI-FewShot0-smallMULTI_VALUE_mnli_zero_plural_after_quantifier
Dataset Card for "MULTI_VALUE_mnli_zero_plural_after_quantifier"
More Information needed
VALUE_mnli_negative_concord
Dataset Card for "VALUE2_mnli_negative_concord"
More Information needed
MULTI_VALUE_mnli_zero_degree
Dataset Card for "MULTI_VALUE_mnli_zero_degree"
More Information needed
TextToText_mnli_seqiomnli_corpus_trainval
Dataset Card for "mnli_corpus_trainval"
More Information needed