datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
eli5
Dataset Card for ELI5
This dataset is a collection of question-answer pairs, collected from the Explain Like I'm 5 subreddit. See ELI5 for additional information.
This dataset can be used directly with Sentence Transformers to train embedding models.
Dataset Subsets
pair subset
Columns: "question", "answer"
Column types: str, str
Examples:{
'question': 'Why chemical weapons considered more indiscriminate than conventional weapons?',
'answer': "Well, any… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/eli5.eli5This dataset is the subset of original eli5 dataset available on hugging face
eli5-gemma-featureseli5_categoryeli5_rlhfELI5 paired
This is a processed version of the eli5 dataset. The dataset was created following very closely the steps in the stack-exchange-paired dataset. The following steps were applied:
Create pairs (response_j, response_k) where j was rated better than k
Sample at most 10 pairs per question
Shuffle the dataset globally
This dataset is designed to be used for preference learning using techniques such as Reinforcement Learning from Human Feedback. The processing notebook is in the… See the full description on the dataset page: https://huggingface.co/datasets/vincentmin/eli5_rlhf.eli5_rlhf_explainlikeim5
ELI5 paired
This is a processed version of the eli5 dataset.
Compared to "eli5_rlhf", this dataset contains only QA pairs from the train split of the eli5 dataset and only from the subreddit explainlikeimfive.
Furthermore, the function
def get_question(example):
title = example["title"]
selftext = example["selftext"]
if selftext:
if selftext[-1] not in [".", "?", "!"]:
seperator = ". "
else:
seperator = " "
question = title… See the full description on the dataset page: https://huggingface.co/datasets/vincentmin/eli5_rlhf_explainlikeim5.train-eli5
ELI5 — Training, unified schema
A normalised copy of the dataset behind the mteb task ELI5, a retrieval training set built from sentence-transformers/eli5. Same queries, documents
and relevance judgements as the benchmark evaluates — reshaped into one strict schema shared by every dataset
in this collection.
Source
sentence-transformers/eli5 @ 6e3b20a7a427 (the revision pinned in mteb)
Domain · languages
long-form QA (Reddit) · eng
Queries / documents / qrels… See the full description on the dataset page: https://huggingface.co/datasets/Hyukkyu/train-eli5.eli5-human-vs-ai
ELI5 Human vs AI (long-form)
This dataset is for training and evaluating AI-writing detectors. It was built
as a clean way to compare known AI text against known human text: every human
answer predates ChatGPT by more than three years, so it is genuinely human by
construction, and every AI answer was written by a named 2026 model, so its origin
is certain too. Most detection datasets have to guess at their labels; this one
does not.
ELI5 answers were chosen because they are… See the full description on the dataset page: https://huggingface.co/datasets/mild-rgb/eli5-human-vs-ai.eli5_bm25_top100_kilt
Dataset Card for "eli5_bm25_top100_kilt"
More Information needed
eli5_precomputed_bestseongil-dn_mteb-eli5-with-reddit_naiveeli5-documenteli5_sample_autorag
license: unknown
eli5_idELI5_embedded
Dataset Card for "ELI5_embedded"
More Information needed
eli5_question_answer_danish
ELI5 question-answer pairs in Danish
About
This dataset is a version of the ELI5 question-answer pairs dataset machine-translated from English to Danish (link to original dataset).
Machine translation is performed using the Helsinki NLP English-to-Danish OPUS-MT model.
The dataset contains ~209k question-answer pairs and can be used to train embedding and question-answer models. Each pair consists of one question ('query') and one passage containing the answer… See the full description on the dataset page: https://huggingface.co/datasets/KennethTM/eli5_question_answer_danish.ELI5-testThis dataset is not an official one, therefore should not be used without care!
eli5eli5_precomputed_topeli5_base_bestELI5-Human-and-AI-Answers
Overview
This dataset uses the questions from the pre-existing ELI5 dataset to generate a corresponding AI generated answer of a similar length for each human written answer. Responses were generated using Google Gemini Flash 2.0 (100k samples) as well as with Claude Haiku 3.0 (10k samples) to act as a cross-model performance validation set.
Data Format
Columns: "question", "real_answers", "generated_answers"
Column Types: str, str, str
Example Record:… See the full description on the dataset page: https://huggingface.co/datasets/shahirsao/ELI5-Human-and-AI-Answers.eli5_subquestioneli5_55mteb-eli5-with-redditeli5-qaeli5_precomputedeli5_lfqa_besteli5_splitThis dataset is the subset of original eli5 dataset available in hugging face space
eli5Split_55eli5-lfqa
ELI5: Long Form Question Answering
https://arxiv.org/pdf/1907.09190
Items (train): 272_634
Items (val): 1_507
Downloaded from:
https://www.kaggle.com/datasets/trandaiphu/eli5-dataset
Tokens ctxs length distribution summary:
min: 152
mean: 3745.35
median (p50): 3736.00
p90: 4037.00
p95: 4152.00
p99: 4432.00
max: 6530
Tokens answers length distribution summary:
rows: 272_634
min: 8
mean: 401.31
median (p50): 217.00
p90: 820.70
p95: 1230.00
p99:… See the full description on the dataset page: https://huggingface.co/datasets/aitetic/eli5-lfqa.