scitail
Datasets
All datasets matching “scitail”scitail
Dataset Card for "scitail"
Dataset Summary
The SciTail dataset is an entailment dataset created from multiple-choice science exams and web sentences. Each question
and the correct answer choice are converted into an assertive statement to form the hypothesis. We use information
retrieval to obtain relevant text from a large text corpus of web sentences, and use these sentences as a premise P. We
crowdsource the annotation of such premise-hypothesis pair as supports… See the full description on the dataset page: https://huggingface.co/datasets/allenai/scitail.scitail
Overview
Original dataset is available on the HuggingFace Hub here.
Dataset curation
This is the same as the snli_format split of the SciTail dataset available on the HuggingFace Hub (i.e., same data, same splits, etc).
The only differences are the following:
selecting only the columns ["sentence1", "sentence2", "gold_label", "label"]
renaming columns with the following mapping {"sentence1": "premise", "sentence2": "hypothesis"}
creating a new column "label" from… See the full description on the dataset page: https://huggingface.co/datasets/pietrolesci/scitail.task1529_scitail1.1_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1529_scitail1.1_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1529_scitail1.1_classification.scitailThe SciTail dataset is an entailment dataset created from multiple-choice science exams and
web sentences. Each question and the correct answer choice are converted into an assertive
statement to form the hypothesis. We use information retrieval to obtain relevant text from
a large text corpus of web sentences, and use these sentences as a premise P. We crowdsource
the annotation of such premise-hypothesis pair as supports (entails) or not (neutral), in order
to create the SciTail dataset. The dataset contains 27,026 examples with 10,101 examples with
entails label and 16,925 examples with neutral label.scitail-sentencestask1554_scitail_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1554_scitail_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1554_scitail_classification.