datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
4D4T
Four Dataset For Training
4D4T: 4-Domain Training Dataset
A curated ~60GB corpus split into four balanced domains for training small language models.
📊 Domain Breakdown
Domain
Source
Format
Math
openbmb/UltraData-Math
data/math/math_train_shard_*.jsonl.gz
History
allenai/c4 (realnewslike)
data/history_news/history_train_shard_*.jsonl.gz
Science
sentence-transformers/s2orc
data/science/science_train_shard_*.jsonl.gz
General… See the full description on the dataset page: https://huggingface.co/datasets/SOMIL366/4D4T.my-distiset-4d99b019
Dataset Card for my-distiset-4d99b019
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/Maralc/my-distiset-4d99b019/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/Maralc/my-distiset-4d99b019.my-distiset-4d3904d1
Dataset Card for my-distiset-4d3904d1
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/A1berto0/my-distiset-4d3904d1/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/A1berto0/my-distiset-4d3904d1.my-distiset-4d4ae360
Dataset Card for my-distiset-4d4ae360
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/webaitesting/my-distiset-4d4ae360/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/webaitesting/my-distiset-4d4ae360.