datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
eli5Explain Like I'm 5 long form QA dataseteli5
Dataset Card for ELI5
This dataset is a collection of question-answer pairs, collected from the Explain Like I'm 5 subreddit. See ELI5 for additional information.
This dataset can be used directly with Sentence Transformers to train embedding models.
Dataset Subsets
pair subset
Columns: "question", "answer"
Column types: str, str
Examples:{
'question': 'Why chemical weapons considered more indiscriminate than conventional weapons?',
'answer': "Well, any… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/eli5.eli5_categoryThe ELI5-Category dataset is a smaller but newer and categorized version of the original ELI5 dataset. After 2017, a tagging system was introduced to this subreddit so that the questions can be categorized into different topics according to their tags. Since the training and validation set is built by questions in different topics, the dataset is expected to alleviate the train/validation overlapping issue in the original ELI5 dataset.eli5This dataset is the subset of original eli5 dataset available on hugging face
eli5_sae_features
Dataset Card for gpt2_eli5_sae_features
This dataset aims to create a corpus of data to help guide research into monosemantic features using SAE's. It has been generated using this raw template
Dataset Details
Dataset Description
This dataset takes the eli5 subset from facebook/kilt_tasks and processes it to be used in SAE research. More specifically, we take the inputs, and tokenize them using the gpt2-small tokenizer. The outputs are tokenized, embedded , and… See the full description on the dataset page: https://huggingface.co/datasets/mksethi/eli5_sae_features.eli5-gemma-featureseli5_categorydetails_dhmeltzer__llama-7b-SFT_eli5_wiki65k_1024_r_64_alpha_16_merged
Dataset Card for Evaluation run of dhmeltzer/llama-7b-SFT_eli5_wiki65k_1024_r_64_alpha_16_merged
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/llama-7b-SFT_eli5_wiki65k_1024_r_64_alpha_16_merged on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 3 run(s). Each run can be found as a specific split in each configuration… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__llama-7b-SFT_eli5_wiki65k_1024_r_64_alpha_16_merged.eli5_rlhfELI5 paired
This is a processed version of the eli5 dataset. The dataset was created following very closely the steps in the stack-exchange-paired dataset. The following steps were applied:
Create pairs (response_j, response_k) where j was rated better than k
Sample at most 10 pairs per question
Shuffle the dataset globally
This dataset is designed to be used for preference learning using techniques such as Reinforcement Learning from Human Feedback. The processing notebook is in the… See the full description on the dataset page: https://huggingface.co/datasets/vincentmin/eli5_rlhf.details_dhmeltzer__llama-7b-SFT_ds_eli5_1024_r_64_alpha_16_merged
Dataset Card for Evaluation run of dhmeltzer/llama-7b-SFT_ds_eli5_1024_r_64_alpha_16_merged
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/llama-7b-SFT_ds_eli5_1024_r_64_alpha_16_merged on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 3 run(s). Each run can be found as a specific split in each configuration, the split… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__llama-7b-SFT_ds_eli5_1024_r_64_alpha_16_merged.details_dhmeltzer__Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16
Dataset Card for Evaluation run of dhmeltzer/Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16 on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16.details_dhmeltzer__Llama-2-7b-hf-eli5-cleaned-wiki65k-1024_qlora_merged
Dataset Card for Evaluation run of dhmeltzer/Llama-2-7b-hf-eli5-cleaned-wiki65k-1024_qlora_merged
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/Llama-2-7b-hf-eli5-cleaned-wiki65k-1024_qlora_merged on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__Llama-2-7b-hf-eli5-cleaned-wiki65k-1024_qlora_merged.details_dhmeltzer__Llama-2-7b-hf-eli5-cleaned-1024_qlora_merged
Dataset Card for Evaluation run of dhmeltzer/Llama-2-7b-hf-eli5-cleaned-1024_qlora_merged
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/Llama-2-7b-hf-eli5-cleaned-1024_qlora_merged on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__Llama-2-7b-hf-eli5-cleaned-1024_qlora_merged.eli5_rlhf_explainlikeim5
ELI5 paired
This is a processed version of the eli5 dataset.
Compared to "eli5_rlhf", this dataset contains only QA pairs from the train split of the eli5 dataset and only from the subreddit explainlikeimfive.
Furthermore, the function
def get_question(example):
title = example["title"]
selftext = example["selftext"]
if selftext:
if selftext[-1] not in [".", "?", "!"]:
seperator = ". "
else:
seperator = " "
question = title… See the full description on the dataset page: https://huggingface.co/datasets/vincentmin/eli5_rlhf_explainlikeim5.details_dhmeltzer__Llama-2-13b-hf-ds_eli5_1024_r_64_alpha_16_merged
Dataset Card for Evaluation run of dhmeltzer/Llama-2-13b-hf-ds_eli5_1024_r_64_alpha_16_merged
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/Llama-2-13b-hf-ds_eli5_1024_r_64_alpha_16_merged on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__Llama-2-13b-hf-ds_eli5_1024_r_64_alpha_16_merged.translated_eli5_dataset_raw_2train-eli5
ELI5 — Training, unified schema
A normalised copy of the dataset behind the mteb task ELI5, a retrieval training set built from sentence-transformers/eli5. Same queries, documents
and relevance judgements as the benchmark evaluates — reshaped into one strict schema shared by every dataset
in this collection.
Source
sentence-transformers/eli5 @ 6e3b20a7a427 (the revision pinned in mteb)
Domain · languages
long-form QA (Reddit) · eng
Queries / documents / qrels… See the full description on the dataset page: https://huggingface.co/datasets/Hyukkyu/train-eli5.eli5-human-vs-ai
ELI5 Human vs AI (long-form)
This dataset is for training and evaluating AI-writing detectors. It was built
as a clean way to compare known AI text against known human text: every human
answer predates ChatGPT by more than three years, so it is genuinely human by
construction, and every AI answer was written by a named 2026 model, so its origin
is certain too. Most detection datasets have to guess at their labels; this one
does not.
ELI5 answers were chosen because they are… See the full description on the dataset page: https://huggingface.co/datasets/mild-rgb/eli5-human-vs-ai.eli5_bm25_top100_kilt
Dataset Card for "eli5_bm25_top100_kilt"
More Information needed
details_dhmeltzer__llama-7b-SFT-qlora-eli5-wiki_DPO_ds_RM_top_2_1024_r_64_alpha_16
Dataset Card for Evaluation run of dhmeltzer/llama-7b-SFT-qlora-eli5-wiki_DPO_ds_RM_top_2_1024_r_64_alpha_16
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/llama-7b-SFT-qlora-eli5-wiki_DPO_ds_RM_top_2_1024_r_64_alpha_16 on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__llama-7b-SFT-qlora-eli5-wiki_DPO_ds_RM_top_2_1024_r_64_alpha_16.eli5_precomputed_bestseongil-dn_mteb-eli5-with-reddit_naiveeli5-documenteli5_sample_autorag
license: unknown
eli5_idELI5_embedded
Dataset Card for "ELI5_embedded"
More Information needed
eli5_question_answer_danish
ELI5 question-answer pairs in Danish
About
This dataset is a version of the ELI5 question-answer pairs dataset machine-translated from English to Danish (link to original dataset).
Machine translation is performed using the Helsinki NLP English-to-Danish OPUS-MT model.
The dataset contains ~209k question-answer pairs and can be used to train embedding and question-answer models. Each pair consists of one question ('query') and one passage containing the answer… See the full description on the dataset page: https://huggingface.co/datasets/KennethTM/eli5_question_answer_danish.ELI5-testThis dataset is not an official one, therefore should not be used without care!
details_dhmeltzer__Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged
Dataset Card for Evaluation run of dhmeltzer/Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged
Dataset Summary
Dataset automatically created during the evaluation run of model dhmeltzer/Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_dhmeltzer__Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged.eli5