datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
medical-question-answering-datasetsNLU-Question-Answering
SEA Question Answering
SEA Question Answering evaluates a model's ability to predict a contiguous span of characters that answers the question about a given passage. It is sampled from TyDi QA-GoldP for Indonesian, IndicQA for Tamil, and XQuaD for Thai and Vietnamese.
Supported Tasks and Leaderboards
SEA Question Answering is designed for evaluating chat or instruction-tuned large language models (LLMs). It is part of the SEA-HELM leaderboard from AI Singapore.… See the full description on the dataset page: https://huggingface.co/datasets/aisingapore/NLU-Question-Answering.quora-question-answer-datasetQuora Question Answer Dataset (Quora-QuAD) contains 56,402 question-answer pairs scraped from Quora.
Usage:
For instructions on fine-tuning a model (Flan-T5) with this dataset, please check out the article: https://www.toughdata.net/blog/post/finetune-flan-t5-question-answer-quora-dataset
Chinese_Question_Answering_Datasetminecraft-question-answer-700k
minecraft-question-answer-700k
Introducing the largest synthetic Minecraft Q&A dataset, covering every topic, game mechanic, item and craft in Minecraft. The dataset was generated by extracting over 18,000 Minecraft wiki pages, and using glaive.ai's synthetic data generation pipeline.
about the dataset
rows - 694,814
tokens - 47,133,624
source - https://minecraft.wiki/
Hit me up on twitter if you see a bug or need a synthetic dataset for your company:… See the full description on the dataset page: https://huggingface.co/datasets/naklecha/minecraft-question-answer-700k.medical-question-answering-datasetsmedical-question-answering-datasetschaii-hindi-and-tamil-question-answeringpsychology-question-answerA JSON formatted dataset comprising 197,180 question and answer pairs covering a wide range of topics encountered in a Bachelor level psychology course. I have included a broad range of question types, topics, and answer styles.
The dataset was created using personal notes and several LLMs (such as GPT4) and manually assessed for veracity and completeness of response. Despite this, the size of the dataset prohibits me from ensuring every single answer is 100% accurate and up-to-date. As such… See the full description on the dataset page: https://huggingface.co/datasets/BoltMonkey/psychology-question-answer.Question-Answering-Generation-Choices
The dataset is a merged compilation of QuAIL, RACE, and Cosmos QA datasets,
having undergone preprocessing.
QuestionAnswering
Serbian Question-Answering Datasets
This repository provides multiple QA datasets in Serbian, suitable for training LLMs to answer questions, perform tasks, or function as chatbots.
Datasets Overview
SQuAD-sr-md – Manually corrected subset of SQuAD-sr (~7k corrected samples), for higher reliability and accuracy.
SerbianQA-Gen – Synthetic QA dataset (~74k samples) generated from encyclopedia articles, Wikipedia pages, and scientific abstracts. Organized into four… See the full description on the dataset page: https://huggingface.co/datasets/te-sla/QuestionAnswering.quran-question-answer-context
Dataset Card for "quran-question-answer-context"
Dataset Summary
Translated the original dataset from Arabic to English and added the Surah ayahs to the context column.
Usage
from datasets import load_dataset
dataset = load_dataset("nazimali/quran-question-answer-context")
DatasetDict({
train: Dataset({
features: ['q_id', 'question', 'answer', 'q_word', 'q_topic', 'fine_class', 'class', 'ontology_concept', 'ontology_concept2', 'source', 'q_src_id'… See the full description on the dataset page: https://huggingface.co/datasets/nazimali/quran-question-answer-context.bodo-legal-question-answering-ai4bharat
Bodo Legal Question Answering Dataset
Overview
This dataset is a Bodo-language legal Question Answering (QA) resource
created for research in low-resource Natural Language Processing (NLP)
and legal language processing.
The supplied source files contain legal judgment contexts together with
multiple questions and answers. For Hugging Face compatibility and
question-answering model training, each question-answer pair has been
flattened into a separate JSONL example… See the full description on the dataset page: https://huggingface.co/datasets/Mwnthai/bodo-legal-question-answering-ai4bharat.eli5_question_answer_danish
ELI5 question-answer pairs in Danish
About
This dataset is a version of the ELI5 question-answer pairs dataset machine-translated from English to Danish (link to original dataset).
Machine translation is performed using the Helsinki NLP English-to-Danish OPUS-MT model.
The dataset contains ~209k question-answer pairs and can be used to train embedding and question-answer models. Each pair consists of one question ('query') and one passage containing the answer… See the full description on the dataset page: https://huggingface.co/datasets/KennethTM/eli5_question_answer_danish.civil-human-rights-question-answering
Dataset Card for rag-prompt
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/sdiazlor/rag-prompt/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/sdiazlor/civil-human-rights-question-answering.bodo-legal-question-answering-iiith
Bodo Legal Question Answering Dataset — IIITH Translation
Overview
A Bodo-language legal Question Answering (QA) resource derived from
English legal judgments. Each example contains a judgment context, a
question, and its corresponding answer.
Data Provenance
Original Legal Source
The underlying English legal judgments were extracted from the publicly
accessible Gauhati High Court judgment repository:… See the full description on the dataset page: https://huggingface.co/datasets/Mwnthai/bodo-legal-question-answering-iiith.climate-question-answersDataset Card for Climate change questions / answers dataset
Dataset DescriptionThis is a first version of a question/answer dataset on climate change and ecology.
The dataset has been created based on a curated list of wikipedia articles on climate change from https://huggingface.co/datasets/pierre-pessarossi/wikipedia-climate-data
For each wikipedia article of the original dataset, a set of question/answers pairs was created. The number of question depends on the initial size of the… See the full description on the dataset page: https://huggingface.co/datasets/pierre-pessarossi/climate-question-answers.question-answer-Subject-Finance-InstructMath-Question-Answerfitness-question-answersA total of 965 q&a pairs i gathered from the web related to physical activity and fitness.
obekt-question-answer-reasoning-micro-v0.1
Obekt Micro Reasoning Dataset (v0.1)
Dataset Description
This is a "micro" dataset containing questions, answers, and reasoning traces. It is generated using the Xiaomi MiMo V2 Flash LLM and is intended for experimental purposes, quick prototyping, and fine-tuning trials where reasoning capability is a focus.
Source Model: xiaomi/mimo-v2-flash
Contains
obekt-question-answer-reasoning-micro-v0.1.csv: The main data file.
Columns:
question: The input query.… See the full description on the dataset page: https://huggingface.co/datasets/obekt/obekt-question-answer-reasoning-micro-v0.1.crypto-sales-question-answersA dataset consisting of questions, answers, and cryptocurrency descriptions
medical-question-answering-datasetsminecraft-question-answer-500k
Minecraft Q&A 500k
This is adapted from naklecha with a lot of filtering.
You can find the exact process here
Question-Answering_Kazakh
🇰🇿 Question-Answering_Kazakh
A comprehensive Kazakh-language question-answer dataset for fine-tuning
and training language models.Created and maintained by Kurumikz. Free to use with attribution.
📌 Overview
Question-Answering_Kazakh is an open-domain QA dataset written entirely
in the Kazakh language (kk). It covers a wide range of topics — from the
history and geography of Kazakhstan to Kazakh grammar, culture, economy, and
language learning (Kazakh ↔ English).… See the full description on the dataset page: https://huggingface.co/datasets/kurumikz/Question-Answering_Kazakh.questionanswering-datasetptbr-question-and-answer
Perguntas e Respostas Brasileiras
Esse dataset é uma compilação das perguntas e respostas em português disponíveis em clips/mqa.
Foi realizada uma limpeza e normalização dos dados, mantendo apenas domínios mais relevantes, removendo texto danosos e inadequados.
O código para a limpeza dos dados pode ser acessado aqui
O principal objetivo deste dataset é ajudar modelos de linguagem natural e modelos de embedding em português a gerar textos e cálculos de similaridade
mais precisos e… See the full description on the dataset page: https://huggingface.co/datasets/emdemor/ptbr-question-and-answer.arabic_dialects_question_and_answerData Content
The file provided: Q/A Reasoning dataset
contains the following columns:
ID # : Denotes the reference ID for:
a. Question
b. Answer to the question
c. Hint
d. Reasoning
e. Word count for items a to d above
Dialects: Contains the following dialects in separate columns:
a. English
b. MSA
c. Emirati
d. Egyptian
e. Levantine Syria
f. Levantine Jordan
g. Levantine Palestine
h. Levantine Lebanon
Data Generation Process
The following are the steps that were followed to curate the data:… See the full description on the dataset page: https://huggingface.co/datasets/CNTXTAI0/arabic_dialects_question_and_answer.Question-answeringsmall-ru
Dataset Card for Question Answering Russian Dataset
🧠 Quick Summary
Небольшой, чистый и тестовый датасет, созданный энтузиастом.Содержит базовые фундаментальные знания по математике, странам и тюркским народам.Подходит для обучения и тестирования моделей в образовательных и исследовательских целях.
📚 Dataset Details
Curated by: @kurumikz
Language(s): Russian (ru)
License: CC-BY 4.0 — свободное использование с обязательным указанием автора
Size Category:… See the full description on the dataset page: https://huggingface.co/datasets/kurumikz/Question-answeringsmall-ru.obekt-question-answer-reasoning-nano-v0.1
Obekt Nano Reasoning Dataset (v0.1)
Dataset Description
This is a small "nano" dataset containing questions, answers, and reasoning traces. It is generated using the Xiaomi MiMo V2 Flash LLM and is intended for experimental purposes, quick prototyping, and fine-tuning trials where reasoning capability is a focus.
Source Model: xiaomi/mimo-v2-flash
Contains
obekt-question-answer-reasoning-nano-v0.1.csv: The main data file.
Columns:
question: The input query.… See the full description on the dataset page: https://huggingface.co/datasets/obekt/obekt-question-answer-reasoning-nano-v0.1.