datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
commonsense_qa
Dataset Card for "commonsense_qa"
Dataset Summary
CommonsenseQA is a new multiple-choice question answering dataset that requires different types of commonsense knowledge
to predict the correct answers . It contains 12,102 questions with one correct answer and four distractor answers.
The dataset is provided in two major training/validation/testing set splits: "Random split" which is the main evaluation
split, and "Question token split", see paper for details.… See the full description on the dataset page: https://huggingface.co/datasets/tau/commonsense_qa.commonsense-qacommonsense_qa_2.0https://github.com/allenai/csqa2
@article{talmor2022commonsenseqa,
title={CommonsenseQA 2.0: Exposing the limits of AI through gamification},
author={Talmor, Alon and Yoran, Ori and Bras, Ronan Le and Bhagavatula, Chandra and Goldberg, Yoav and Choi, Yejin and Berant, Jonathan},
journal={arXiv preprint arXiv:2201.05320},
year={2022}
}
DemoFeedbackcommonsense_170khttps://github.com/AGI-Edgerunners/LLM-Adapters/blob/main/ft-training_set/commonsense_170k.json
task828_copa_commonsense_cause_effect
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task828_copa_commonsense_cause_effect
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task828_copa_commonsense_cause_effect.CommonsenseQA-Explained-by-ChatGPTThis is a dataset with explanations from ChatGPT for the correct and incorrect answers in CommonsenseQA. The explanations are generated by prompting ChatGPT with answer keys and in-context examples. We expect this dataset to be an useful source for understanding the commonsense reasoning ability of LLMs or training other LMs.
commonsense_corpus4.7Mtask827_copa_commonsense_reasoning
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task827_copa_commonsense_reasoning
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task827_copa_commonsense_reasoning.task116_com2sense_commonsense_reasoning
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task116_com2sense_commonsense_reasoning
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task116_com2sense_commonsense_reasoning.commonsense_qatask403_creak_commonsense_inference
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task403_creak_commonsense_inference
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task403_creak_commonsense_inference.commonsense-candidatesCommonsenseQA1000COTtask1135_xcsr_en_commonsense_mc_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1135_xcsr_en_commonsense_mc_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1135_xcsr_en_commonsense_mc_classification.task291_semeval_2020_task4_commonsense_validation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task291_semeval_2020_task4_commonsense_validation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task291_semeval_2020_task4_commonsense_validation.CRAFT-CommonSenseQA
CRAFT-CommonSenseQA
This is a synthetic dataset generated with the CRAFT framework proposed in the paper CRAFT Your Dataset: Task-Specific Synthetic Data Generation Through Corpus Retrieval and Augmentation.
The correctness of the data has not been verified in detail, but training on this data and evaluating on human-curated commonsense question-answering data proved highly beneficial.
4 synthetic dataset sizes (S, M, L, XL) are available, and training on them yields consistent… See the full description on the dataset page: https://huggingface.co/datasets/ingoziegler/CRAFT-CommonSenseQA.commonsense_filtered
Dataset Summary
The commonsense reasoning tasks consist of 8 subtasks, each with predefined training and testing sets, as described by LLM-Adapters (Hu et al., 2023). The following table lists the details of each sub-dataset.
Train
Test
Information
BoolQ (Clark et al., 2019)
9427
3270
Question-answering dataset for yes/no questions
PIQA (Bisk et al., 2020)
16113
1838
Questions with two solutions requiring physical commonsense to answer
SIQA (Sap et al., 2019)
33410… See the full description on the dataset page: https://huggingface.co/datasets/fxmeng/commonsense_filtered.commonsense-baselineomcs_dataset_of_commonsense_facts
Dataset Card for "omcs_dataset_of_commonsense_facts"
When people communicate, they rely on a large body of shared common sense knowledge in order to understand each other. Many barriers we face today in artificial intelligence and user interface design are due to the fact that computers do not share this knowledge. To improve computers' understanding of the world that people live in and talk about, we need to provide them with usable knowledge about the basic relationships between… See the full description on the dataset page: https://huggingface.co/datasets/dutta18/omcs_dataset_of_commonsense_facts.task1144_xcsr_sw_commonsense_mc_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1144_xcsr_sw_commonsense_mc_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1144_xcsr_sw_commonsense_mc_classification.commonsense-qa-2CommonsenseQA-GPT4ominiCommonsense-15KCOM2-commonsensechatgpt4-commonsense-qa
Synthetic CommonSense
Generated using ChatGPT4, originally from https://huggingface.co/datasets/commonsense_qa
Notebook at https://github.com/mesolitica/malaysian-dataset/tree/master/question-answer/chatgpt4-commonsense
synthetic-commonsense.jsonl, 36332 rows, 7.34 MB.
Example data
{'question': '1. Seseorang yang bersara mungkin perlu kembali bekerja jika mereka apa?\n A. mempunyai hutang\n B. mencari pendapatan\n C. meninggalkan pekerjaan\n D. memerlukan… See the full description on the dataset page: https://huggingface.co/datasets/mesolitica/chatgpt4-commonsense-qa.commonsense_cot_partial_raw
Commonsense QA CoT (Partial, Raw, No Human Annotation)
Dataset Summary
Seeded by the CommonsenseQA dataset (tau/commonsense_qa) this preliminary set randomly samples 1,000 question-answer
entries and uses Mixtral (mistralai/Mixtral-8x7B-Instruct-v0.1) to generate 3 unique CoT (Chain-of-Thought) rationales.
This was created as the preliminary step towards fine-tuning a LM (language model) to specialize on commonsense reasoning.
The working hypothesis, inspired by the… See the full description on the dataset page: https://huggingface.co/datasets/peterkchung/commonsense_cot_partial_raw.hendrycks_ethics_commonsensecommonsenseqa_with_content_words
Dataset Card for "commonsenseqa_with_content_words"
More Information needed
task073_commonsenseqa_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task073_commonsenseqa_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task073_commonsenseqa_answer_generation.