clara
Datasets
All datasets matching “clara”modular-s2orc-parquetCLaRa_multi_stage
CLaRa: Bridging Retrieval and Generation with Continuous Latent Reasoning
This is the official dataset for the CLaRa paper which contains training and evaluation data for the CLaRa model, organized into three main categories: pretraining, instruction tuning, and end-to-end tuning.
Dataset Structure
1. Pretraining Data
pretraining: Large-scale pretraining data for the compressor learning
Format: JSONL with fields: data_type, question, answers… See the full description on the dataset page: https://huggingface.co/datasets/apple/CLaRa_multi_stage.m2d2-wiki-decon-parquetmodular-s2orc
Dataset Card for Modular S2ORC
Topically and temporally partitioned data from S2ORC, used for continued pre-training experiments in "Scalable Data Ablation Approximations for Language Models through Modular Training and Merging" to be presented at EMNLP 2024.
Validation and test splits are determined by 'sha1' values in metadata.
More details to come.
Dataset Details
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]:… See the full description on the dataset page: https://huggingface.co/datasets/claran/modular-s2orc.m2d2-wiki-decon
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Dataset Sources [optional]
Repository: [More… See the full description on the dataset page: https://huggingface.co/datasets/claran/m2d2-wiki-decon.seed-pretrain-decon-parquet