datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Chinese-Logic-Multiple-ChoiceTraditional-Chinese-Medicine-Multiple_choice_question
Discription
This dataset is sourced from the website of the Ministry of Examination, R.O.C (Taiwan) and contains past exam questions from the national Traditional Chinese Medicine examinations in Taiwan. The exam comprises six subjects. This dataset specifically includes questions from two subjects, including the History of Traditional Chinese Medicine, Basic Theories of Traditional Chinese Medicine, Neijing, Nanjing, Traditional Chinese Medicine Prescription Studies, and… See the full description on the dataset page: https://huggingface.co/datasets/Liavan/Traditional-Chinese-Medicine-Multiple_choice_question.sat_multiple_choice_math_may_23This is the set of math SAT questions from the May 2023 SAT, taken from here: https://www.mcelroytutoring.com/lower.php?url=44-official-sat-pdfs-and-82-official-act-pdf-practice-tests-free.
Questions that included images were not included but all other math questions, including those that have tables were included.
cycic_multiplechoicehttps://colab.research.google.com/drive/16nyxZPS7-ZDFwp7tn_q72Jxyv0dzK1MP?usp=sharing
@article{Kejriwal2020DoFC,
title={Do Fine-tuned Commonsense Language Models Really Generalize?},
author={Mayank Kejriwal and Ke Shen},
journal={ArXiv},
year={2020},
volume={abs/2011.09159}
}
added for
@article{sileo2023tasksource,
title={tasksource: Structured Dataset Preprocessing Annotations for Frictionless Extreme Multi-Task Learning and Evaluation},
author={Sileo, Damien},
url=… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/cycic_multiplechoice.kvqa_multiple_choicelilac-TruthfulQA-MultipleChoice
lilac/TruthfulQA-MultipleChoice
This dataset is a Lilac processed dataset. Original dataset: https://huggingface.co/datasets/truthful_qa
To download the dataset to a local directory:
lilac download lilacai/lilac-TruthfulQA-MultipleChoice
or from python with:
ll.download("lilacai/lilac-TruthfulQA-MultipleChoice")
AfriMCQA-multiple-choice
Afri-MCQA multiple choice visual QA (MTEB)
Culturally grounded multiple choice questions about photographs, in 16 African
languages. Each row is a question, the photograph it asks about, its answer
options, and which of them is correct. Options are shuffled by a hash of the
question, because the source always lists the answer first.
Built from Atnafu/Afri-MCQA at revision 8b8c53d, cc-by-nc-4.0, using
the official dev split, the only one where the correct answer is labelled.… See the full description on the dataset page: https://huggingface.co/datasets/vnahata/AfriMCQA-multiple-choice.labeled-multiple-choice-explained-mistral-reasoningtask750_aqua_multiple_choice_answering
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task750_aqua_multiple_choice_answering
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task750_aqua_multiple_choice_answering.openorca-multiplechoice-10kA 10k subset of OpenOrca dataset, focusing on multiple choice questions.
Credit to Tian Xia.
labeled-multiple-choice-explainedThis dataset is based on under-tree/labeled-multiple-choice but using GPT-3.5-turbo to generate explanations for each answer option.
This was a very basic attempt to follow the Orca paper approach of a 'teacher' model to provide more context to some trivia questions.
Questions were deduplicated based on the question text.
I used the python library guidance to help generate the prompts. Below is the prompt template I used.
{{#role 'system'~}}
You are an AI assistant that helps people find… See the full description on the dataset page: https://huggingface.co/datasets/layoric/labeled-multiple-choice-explained.labeled-multiple-choice-explained-falcon-reasoningmedical_multiple_choice_qawikipedia_multiple_choice_qa
Galician and Portuguese Multiple-Choice QA Instruction Subsets
Dataset description
This dataset contains two instruction-tuning subsets for multiple-choice question answering in Galician and Portuguese:
gl_wikipedia_multiple_choice_qa (1,486 instances)
pt_wikipedia_multiple_choice_qa (547 instances)
Both subsets are reformatted versions of QA data originally included in the cpt_instruction_datasets collection, adapted here as standalone instruction-style datasets.
Each… See the full description on the dataset page: https://huggingface.co/datasets/proxectonos/wikipedia_multiple_choice_qa.kvqa_multiple_choice3GPP-QA-MultipleChoicemultiple-choice-questions
Questões de Múltipla Escolha - Base de dados (PT-BR)
Contextualização
Este repositório contém uma base de dados (data.json) com questões de múltipla escolha, a qual foi utilizada principalmente no desenvolvimento de modelos de recuperação de informação.
Descrição do conjunto de dados
O conjunto de dados é composto por questões de múltipla escolha, abrangendo uma variedade de temas dentro da área da Ciência da Computação. Cada questão é estruturada em formato… See the full description on the dataset page: https://huggingface.co/datasets/mateus-hamade/multiple-choice-questions.legal-multiple-choice-v2abc-multiple-choice
abc-multiple-choice Dataset
abc-multiple-choice は、競技クイズの大会「abc」で使用された4択問題を元に作成された、多肢選択式の質問応答データセットです。
データセットの詳細については、下記の発表資料を参照してください。
鈴木正敏. 4択クイズを題材にした多肢選択式日本語質問応答データセットの構築. 言語処理学会第30回年次大会 (NLP2024) 併設ワークショップ 日本語言語資源の構築と利用性の向上 (JLR2024), 2024. [PDF]
下記の GitHub リポジトリで、本データセットを用いた評価実験のスクリプトを管理しています。
https://github.com/cl-tohoku/abc-multiple-choice
ライセンス
本データセットのクイズ問題の著作権は abc/EQIDEN 実行委員会 に帰属します。
本データセットは研究目的での利用許諾を得ているものです。商用目的での利用は不可とします。
GenQA_multiple_choice
Dataset Card for "GenQA_multiple_choice"
More Information needed
Vietnamese-Openorca-Multiplechoice-gg-translatedMultiple_Choice-Turkishlabeled-multiple-choice-explained-falcon-tokenizedkorean-bar-exam-moj-multiple-choice
Korean Bar Exam Multiple-Choice Questions and Answers (MOJ)
대한민국 법무부가 공개한 변호사시험 선택형(다지선다) 기출문제와 공식 정답을 문항 단위로 정리한 데이터셋입니다.
이 데이터셋은 해설 데이터가 아니라 문제 -> 정답 번호 학습/평가에 맞춰져 있습니다.
SFT에 바로 쓸 파일
SFT에 가장 바로 쓰기 좋은 파일은 다음입니다.
data/questions.csv
핵심 컬럼:
question_text: 문제 원문과 선택지를 포함한 전체 텍스트
stem: 문제 본문
choices_json: 선택지 배열(JSON 문자열)
answer: 공식 정답 번호
round, year, subject, question_no: 회차, 연도, 과목, 문항 번호
source_article_url, source_file_url, source_license: 출처와 라이선스 추적 정보… See the full description on the dataset page: https://huggingface.co/datasets/gyung/korean-bar-exam-moj-multiple-choice.multiple-choice-checkpoint-downloadslabeled-multiple-choice
Dataset Card for "labeled-multiple-choice"
More Information needed
legal-multiple-choice-v3labeled-multiple-choice-explainedgenetic-counselor-multiple-choiceA collection of multiple-choice questions intended for students preparing for the
American Board of Genetic Counseling (ABGC) Certification Examination.
Also see the genetic-counselor-freeform-questions evaluation set.
A genetic counselor must be prepared to answer questions about inheritance of traits,
medical statistics, testing, empathetic and ethical conversations with patients,
and observing symptoms.
For evaluation only
The goal of this dataset is to evaluate LLMs and… See the full description on the dataset page: https://huggingface.co/datasets/monsoon-nlp/genetic-counselor-multiple-choice.ParsiNLU-multiple-choice