datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
CLaRa_multi_stage
CLaRa: Bridging Retrieval and Generation with Continuous Latent Reasoning
This is the official dataset for the CLaRa paper which contains training and evaluation data for the CLaRa model, organized into three main categories: pretraining, instruction tuning, and end-to-end tuning.
Dataset Structure
1. Pretraining Data
pretraining: Large-scale pretraining data for the compressor learning
Format: JSONL with fields: data_type, question, answers… See the full description on the dataset page: https://huggingface.co/datasets/apple/CLaRa_multi_stage.m2d2-wiki-decon
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Dataset Sources [optional]
Repository: [More… See the full description on the dataset page: https://huggingface.co/datasets/claran/m2d2-wiki-decon.clara-stage2-data
Clara Stage 2 Training Data
Training data for Clara Stage 2 (Compression Instruction Tuning).
Dataset Description
This dataset contains high-quality QA pairs with single documents for training Clara's decoder adapter to generate answers from compressed document representations.
Data Format
Each record contains:
question: The query/question
answer: Gold answer
docs: List containing 1 document
meta: Source description
metadata: Additional metadata (repo, scope… See the full description on the dataset page: https://huggingface.co/datasets/dl3239491/clara-stage2-data.seed-pretrain-decon
Dataset Card for Dataset Name
Pre-training corpus for seed models in "Scalable Data Ablation Approximations for Language Models through Modular Training and Merging", to be presented at EMNLP 2024.
Dataset Details
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]… See the full description on the dataset page: https://huggingface.co/datasets/claran/seed-pretrain-decon.