datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
loft-rag-nq-128k
LOFT RAG - Natural Questions (128k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Natural Questions
Context Length: 128k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-nq-128k.loft-rag-hotpotqa-32k
LOFT RAG - HotpotQA (32k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: HotpotQA
Context Length: 32k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-hotpotqa-32k.loft-rag-musique-32k
LOFT RAG - MuSiQue (32k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: MuSiQue
Context Length: 32k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-musique-32k.loft-rag-nq-32k
LOFT RAG - Natural Questions (32k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Natural Questions
Context Length: 32k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-nq-32k.loft-rag-hotpotqa-128k
LOFT RAG - HotpotQA (128k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: HotpotQA
Context Length: 128k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-hotpotqa-128k.loft-rag-qampari-32k
LOFT RAG - Qampari (32k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Qampari
Context Length: 32k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-qampari-32k.loft-rag-quest-32k
LOFT RAG - Quest (32k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Quest
Context Length: 32k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot examples… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-quest-32k.loft-rag-musique-128k
LOFT RAG - MuSiQue (128k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: MuSiQue
Context Length: 128k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-musique-128k.loft-rag-qampari-128k
LOFT RAG - Qampari (128k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Qampari
Context Length: 128k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-qampari-128k.loft-rag-quest-128k
LOFT RAG - Quest (128k)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Quest
Context Length: 128k
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-quest-128k.LoFTI
LoFTI: Localization and Factuality Transfer to Indian Locales
LoFTI is a benchmark dataset that can be used to evaluate an LLM’s localization and factual text transfer capabilities. LoFTI consists of factual statements about entities in source and target locations; the source locations are spread across the globe and the target locations are all within India with varying degrees of hyperlocality (country, states, cities). The entities span a wide variety of categories.… See the full description on the dataset page: https://huggingface.co/datasets/sonasimon/LoFTI.loft-rag-quest-1m
LOFT RAG - Quest (1m)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Quest
Context Length: 1m
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot examples… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-quest-1m.loft-rag-hotpotqa-1m
LOFT RAG - HotpotQA (1m)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: HotpotQA
Context Length: 1m
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-hotpotqa-1m.loft-rag-nq-1m
LOFT RAG - Natural Questions (1m)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Natural Questions
Context Length: 1m
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-nq-1m.loft-rag-musique-1m
LOFT RAG - MuSiQue (1m)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: MuSiQue
Context Length: 1m
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-musique-1m.loft-rag-qampari-1m
LOFT RAG - Qampari (1m)
Dataset Description
This dataset is part of the LOFT (Long-context Open Foundation Tasks) benchmark, specifically the RAG (Retrieval-Augmented Generation) task.
Dataset: Qampari
Context Length: 1m
Task Type: RAG (Retrieval-Augmented Generation)
Language: English
Source: LOFT Benchmark (Google DeepMind)
Dataset Structure
Data Fields
context (string): Full prompt context including corpus documents and few-shot… See the full description on the dataset page: https://huggingface.co/datasets/f20180301/loft-rag-qampari-1m.
