datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Chinese-Logic-Multiple-ChoiceTraditional-Chinese-Medicine-Multiple_choice_question
Discription
This dataset is sourced from the website of the Ministry of Examination, R.O.C (Taiwan) and contains past exam questions from the national Traditional Chinese Medicine examinations in Taiwan. The exam comprises six subjects. This dataset specifically includes questions from two subjects, including the History of Traditional Chinese Medicine, Basic Theories of Traditional Chinese Medicine, Neijing, Nanjing, Traditional Chinese Medicine Prescription Studies, and… See the full description on the dataset page: https://huggingface.co/datasets/Liavan/Traditional-Chinese-Medicine-Multiple_choice_question.sat_multiple_choice_math_may_23This is the set of math SAT questions from the May 2023 SAT, taken from here: https://www.mcelroytutoring.com/lower.php?url=44-official-sat-pdfs-and-82-official-act-pdf-practice-tests-free.
Questions that included images were not included but all other math questions, including those that have tables were included.
cycic_multiplechoicehttps://colab.research.google.com/drive/16nyxZPS7-ZDFwp7tn_q72Jxyv0dzK1MP?usp=sharing
@article{Kejriwal2020DoFC,
title={Do Fine-tuned Commonsense Language Models Really Generalize?},
author={Mayank Kejriwal and Ke Shen},
journal={ArXiv},
year={2020},
volume={abs/2011.09159}
}
added for
@article{sileo2023tasksource,
title={tasksource: Structured Dataset Preprocessing Annotations for Frictionless Extreme Multi-Task Learning and Evaluation},
author={Sileo, Damien},
url=… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/cycic_multiplechoice.kvqa_multiple_choicelilac-TruthfulQA-MultipleChoice
lilac/TruthfulQA-MultipleChoice
This dataset is a Lilac processed dataset. Original dataset: https://huggingface.co/datasets/truthful_qa
To download the dataset to a local directory:
lilac download lilacai/lilac-TruthfulQA-MultipleChoice
or from python with:
ll.download("lilacai/lilac-TruthfulQA-MultipleChoice")
AfriMCQA-multiple-choice
Afri-MCQA multiple choice visual QA (MTEB)
Culturally grounded multiple choice questions about photographs, in 16 African
languages. Each row is a question, the photograph it asks about, its answer
options, and which of them is correct. Options are shuffled by a hash of the
question, because the source always lists the answer first.
Built from Atnafu/Afri-MCQA at revision 8b8c53d, cc-by-nc-4.0, using
the official dev split, the only one where the correct answer is labelled.… See the full description on the dataset page: https://huggingface.co/datasets/vnahata/AfriMCQA-multiple-choice.openorca-multiplechoice-10kA 10k subset of OpenOrca dataset, focusing on multiple choice questions.
Credit to Tian Xia.
labeled-multiple-choice-explained-mistral-reasoninglabeled-multiple-choice-explained-falcon-reasoninglabeled-multiple-choice-explainedThis dataset is based on under-tree/labeled-multiple-choice but using GPT-3.5-turbo to generate explanations for each answer option.
This was a very basic attempt to follow the Orca paper approach of a 'teacher' model to provide more context to some trivia questions.
Questions were deduplicated based on the question text.
I used the python library guidance to help generate the prompts. Below is the prompt template I used.
{{#role 'system'~}}
You are an AI assistant that helps people find… See the full description on the dataset page: https://huggingface.co/datasets/layoric/labeled-multiple-choice-explained.task750_aqua_multiple_choice_answering
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task750_aqua_multiple_choice_answering
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task750_aqua_multiple_choice_answering.GenQA_multiple_choice
Dataset Card for "GenQA_multiple_choice"
More Information needed
wikipedia_multiple_choice_qa
Galician and Portuguese Multiple-Choice QA Instruction Subsets
Dataset description
This dataset contains two instruction-tuning subsets for multiple-choice question answering in Galician and Portuguese:
gl_wikipedia_multiple_choice_qa (1,486 instances)
pt_wikipedia_multiple_choice_qa (547 instances)
Both subsets are reformatted versions of QA data originally included in the cpt_instruction_datasets collection, adapted here as standalone instruction-style datasets.
Each… See the full description on the dataset page: https://huggingface.co/datasets/proxectonos/wikipedia_multiple_choice_qa.medical_multiple_choice_qaVietnamese-Openorca-Multiplechoice-gg-translatedmultiple-choice-questions
Questões de Múltipla Escolha - Base de dados (PT-BR)
Contextualização
Este repositório contém uma base de dados (data.json) com questões de múltipla escolha, a qual foi utilizada principalmente no desenvolvimento de modelos de recuperação de informação.
Descrição do conjunto de dados
O conjunto de dados é composto por questões de múltipla escolha, abrangendo uma variedade de temas dentro da área da Ciência da Computação. Cada questão é estruturada em formato… See the full description on the dataset page: https://huggingface.co/datasets/mateus-hamade/multiple-choice-questions.Multiple_Choice-Turkishlegal-multiple-choice-v2grammar_et_multiple_choiceTalTechNLP/grammar_et formatted as a multiple-choice problem.
genetic-counselor-multiple-choiceA collection of multiple-choice questions intended for students preparing for the
American Board of Genetic Counseling (ABGC) Certification Examination.
Also see the genetic-counselor-freeform-questions evaluation set.
A genetic counselor must be prepared to answer questions about inheritance of traits,
medical statistics, testing, empathetic and ethical conversations with patients,
and observing symptoms.
For evaluation only
The goal of this dataset is to evaluate LLMs and… See the full description on the dataset page: https://huggingface.co/datasets/monsoon-nlp/genetic-counselor-multiple-choice.3GPP-QA-MultipleChoicelabeled-multiple-choice-explained-falcon-tokenizedabc-multiple-choice
abc-multiple-choice Dataset
abc-multiple-choice は、競技クイズの大会「abc」で使用された4択問題を元に作成された、多肢選択式の質問応答データセットです。
データセットの詳細については、下記の発表資料を参照してください。
鈴木正敏. 4択クイズを題材にした多肢選択式日本語質問応答データセットの構築. 言語処理学会第30回年次大会 (NLP2024) 併設ワークショップ 日本語言語資源の構築と利用性の向上 (JLR2024), 2024. [PDF]
下記の GitHub リポジトリで、本データセットを用いた評価実験のスクリプトを管理しています。
https://github.com/cl-tohoku/abc-multiple-choice
ライセンス
本データセットのクイズ問題の著作権は abc/EQIDEN 実行委員会 に帰属します。
本データセットは研究目的での利用許諾を得ているものです。商用目的での利用は不可とします。
legal-multiple-choice-v3kvqa_multiple_choicePuzzleVQA-MultipleChoice-QAlabeled-multiple-choice-explainedNemotron-Pretraining-Multiple-Choice-NL-train-shuffledcowese_abrev_multiplechoice
Dataset Card for "cowese_abrev_multiplechoice"
More Information needed