datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
commonsense_qa
Dataset Card for "commonsense_qa"
Dataset Summary
CommonsenseQA is a new multiple-choice question answering dataset that requires different types of commonsense knowledge
to predict the correct answers . It contains 12,102 questions with one correct answer and four distractor answers.
The dataset is provided in two major training/validation/testing set splits: "Random split" which is the main evaluation
split, and "Question token split", see paper for details.… See the full description on the dataset page: https://huggingface.co/datasets/tau/commonsense_qa.commonsense-qaphysical-commonsensecommonsense_qa_2.0https://github.com/allenai/csqa2
@article{talmor2022commonsenseqa,
title={CommonsenseQA 2.0: Exposing the limits of AI through gamification},
author={Talmor, Alon and Yoran, Ori and Bras, Ronan Le and Bhagavatula, Chandra and Goldberg, Yoav and Choi, Yejin and Berant, Jonathan},
journal={arXiv preprint arXiv:2201.05320},
year={2022}
}
DemoFeedbackcommonsense_170khttps://github.com/AGI-Edgerunners/LLM-Adapters/blob/main/ft-training_set/commonsense_170k.json
task828_copa_commonsense_cause_effect
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task828_copa_commonsense_cause_effect
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task828_copa_commonsense_cause_effect.common_sense_reasoningThis is the repository containing LoRA checkpoints tuned on common sense reasoning datasets with 0.5B foundation model, served as training data for DnD.
commonsense_corpus4.7Mtask116_com2sense_commonsense_reasoning
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task116_com2sense_commonsense_reasoning
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task116_com2sense_commonsense_reasoning.task827_copa_commonsense_reasoning
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task827_copa_commonsense_reasoning
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task827_copa_commonsense_reasoning.CommonsenseQA-Explained-by-ChatGPTThis is a dataset with explanations from ChatGPT for the correct and incorrect answers in CommonsenseQA. The explanations are generated by prompting ChatGPT with answer keys and in-context examples. We expect this dataset to be an useful source for understanding the commonsense reasoning ability of LLMs or training other LMs.
commonsense_qatask403_creak_commonsense_inference
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task403_creak_commonsense_inference
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task403_creak_commonsense_inference.commonsense-candidatesCommonsenseQA1000COTtask1135_xcsr_en_commonsense_mc_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1135_xcsr_en_commonsense_mc_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1135_xcsr_en_commonsense_mc_classification.task291_semeval_2020_task4_commonsense_validation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task291_semeval_2020_task4_commonsense_validation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task291_semeval_2020_task4_commonsense_validation.CRAFT-CommonSenseQA
CRAFT-CommonSenseQA
This is a synthetic dataset generated with the CRAFT framework proposed in the paper CRAFT Your Dataset: Task-Specific Synthetic Data Generation Through Corpus Retrieval and Augmentation.
The correctness of the data has not been verified in detail, but training on this data and evaluating on human-curated commonsense question-answering data proved highly beneficial.
4 synthetic dataset sizes (S, M, L, XL) are available, and training on them yields consistent… See the full description on the dataset page: https://huggingface.co/datasets/ingoziegler/CRAFT-CommonSenseQA.commonsense_filtered
Dataset Summary
The commonsense reasoning tasks consist of 8 subtasks, each with predefined training and testing sets, as described by LLM-Adapters (Hu et al., 2023). The following table lists the details of each sub-dataset.
Train
Test
Information
BoolQ (Clark et al., 2019)
9427
3270
Question-answering dataset for yes/no questions
PIQA (Bisk et al., 2020)
16113
1838
Questions with two solutions requiring physical commonsense to answer
SIQA (Sap et al., 2019)
33410… See the full description on the dataset page: https://huggingface.co/datasets/fxmeng/commonsense_filtered.task1144_xcsr_sw_commonsense_mc_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1144_xcsr_sw_commonsense_mc_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1144_xcsr_sw_commonsense_mc_classification.commonsense-baselineomcs_dataset_of_commonsense_facts
Dataset Card for "omcs_dataset_of_commonsense_facts"
When people communicate, they rely on a large body of shared common sense knowledge in order to understand each other. Many barriers we face today in artificial intelligence and user interface design are due to the fact that computers do not share this knowledge. To improve computers' understanding of the world that people live in and talk about, we need to provide them with usable knowledge about the basic relationships between… See the full description on the dataset page: https://huggingface.co/datasets/dutta18/omcs_dataset_of_commonsense_facts.CommonsenseQA-GPT4ominicommonsense-qa-2Commonsense-15KCOM2-commonsensecommonsense-embodied-aiA CommonSense Reasoning Dataset pertaining to Physical Commonsense affordance of objects.
https://github.com/Ayush8120/COAT
commonsense-dialogues2
Dataset Card for "commonsense-dialogues2"
More Information needed
commonsense_cot_partial_raw
Commonsense QA CoT (Partial, Raw, No Human Annotation)
Dataset Summary
Seeded by the CommonsenseQA dataset (tau/commonsense_qa) this preliminary set randomly samples 1,000 question-answer
entries and uses Mixtral (mistralai/Mixtral-8x7B-Instruct-v0.1) to generate 3 unique CoT (Chain-of-Thought) rationales.
This was created as the preliminary step towards fine-tuning a LM (language model) to specialize on commonsense reasoning.
The working hypothesis, inspired by the… See the full description on the dataset page: https://huggingface.co/datasets/peterkchung/commonsense_cot_partial_raw.