datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
lfqa-max-answer-length-512
Dataset Card
Dataset Description
The dataset contains simple, long-form answers to questions and corresponding contexts.
Similar to ELI5 but with context.
This dataset is a filtered version of LLukas22/lfqa_preprocessed,
which in turn is a processed and simplified version of of vblagoje's lfqa_support_docs and lfqa datasets.
I have filtered out overly long answers, based on the number of tokens in the answer using the LED tokenizer.
It can be reproduced with the notebook… See the full description on the dataset page: https://huggingface.co/datasets/stefanbschneider/lfqa-max-answer-length-512.lfqa_preprocessed
Dataset Card for "stefanbschneider/lfqa_preprocessed"
Dataset Description
The dataset contains simple, long-form answers to questions and corresponding contexts.
Similar to ELI5 but with context.
This dataset is a filtered version of LLukas22/lfqa_preprocessed,
which in turn is a processed and simplified version of of vblagoje's lfqa_support_docs and lfqa datasets.
This dataset (stefanbschneider/lfqa_preprocessed) has filtered out overly long answers (around 3%).
It can… See the full description on the dataset page: https://huggingface.co/datasets/stefanbschneider/lfqa_preprocessed.lfqa-max-answer-length-1024
Dataset Card
Dataset Description
The dataset contains simple, long-form answers to questions and corresponding contexts.
Similar to ELI5 but with context.
This dataset is a filtered version of LLukas22/lfqa_preprocessed,
which in turn is a processed and simplified version of of vblagoje's lfqa_support_docs and lfqa datasets.
I have filtered out overly long answers, based on the number of tokens in the answer using the LED tokenizer.
It can be reproduced with the notebook… See the full description on the dataset page: https://huggingface.co/datasets/stefanbschneider/lfqa-max-answer-length-1024.lfqa-preprocessed-itlfqa_preprocessed
Dataset Card for "lfqa_preprocessed"
Dataset Summary
This is a simplified version of vblagoje's lfqa_support_docs and lfqa datasets.
It was generated by me to have a more straight forward way to train Seq2Seq models on context based long form question answering tasks.
Dataset Structure
Data Instances
An example of 'train' looks as follows.
{
"question": "what's the difference between a forest and a wood?",
"answer": "They're used… See the full description on the dataset page: https://huggingface.co/datasets/LLukas22/lfqa_preprocessed.NAITS_LFQA_with_supports_v2
NAITS_LFQA_with_supports_v2
Dataset Description
NAITS_LFQA_with_supports_v2 is a bilingual Arabic-English dataset designed for Long-Form Question Answering (LFQA) and Retrieval-Augmented Generation (RAG) research.
The dataset contains 102 manually curated samples. Each sample consists of:
A question in Arabic and English.
A long-form answer in Arabic and English.
Supporting passages in Arabic and English from which the answer can be derived.
A reference field… See the full description on the dataset page: https://huggingface.co/datasets/fahdsoliman/NAITS_LFQA_with_supports_v2.LFQAKnowledgeBase