babylm-2026
BabyLM-2026-Strict-Small
Detoxified 10M Strict-Small BabyLM Training Dataset (BabyLM Turns 4, 2026 BabyLM)
BabyLM 2026 Strict-Small training set. Total: 10M tokens.
Please cite the following:
@misc{choshen2026babylmturns4papers,
title={BabyLM Turns 4: Call for Papers for the 2026 BabyLM Workshop},
author={Leshem Choshen and Ryan Cotterell and Mustafa Omer Gul and Jaap Jumelet and Tal Linzen and Aaron Mueller and Suchir Salhan and Raj Sanjay Shah and Alex Warstadt and Ethan Gotlieb Wilcox}… See the full description on the dataset page: https://huggingface.co/datasets/BabyLM-community/BabyLM-2026-Strict-Small.BabyLM-2026-Strict
Detoxified 100M BabyLM Training Dataset (BabyLM Turns 4, 2026 BabyLM)
BabyLM 2026 strict training set. Total: 100M tokens.
Please cite the following:
@misc{choshen2026babylmturns4papers,
title={BabyLM Turns 4: Call for Papers for the 2026 BabyLM Workshop},
author={Leshem Choshen and Ryan Cotterell and Mustafa Omer Gul and Jaap Jumelet and Tal Linzen and Aaron Mueller and Suchir Salhan and Raj Sanjay Shah and Alex Warstadt and Ethan Gotlieb Wilcox},
year={2026}… See the full description on the dataset page: https://huggingface.co/datasets/BabyLM-community/BabyLM-2026-Strict.BabyLM-2026-Strict-Evalsbabylm-2026-fr-92m-5seed-resultsbabylm-2026-nexus-boundaries
BabyLM Nexus Boundary-Preserving Corpus
Metadata
dataset: babylm.curation.strict_small_nexus_boundaries
repo_id: miguelcsx/babylm-2026-nexus-boundaries
license: other
language: en
tags: babylm, strict-small, document-boundaries
Size
total_words: 9999979
documents: 17081
Files
records: data.jsonl
train: training/train.txt
validation: training/val.txt
shards: training/shards/
hf_disk: hf/
manifest: publish_manifest.json… See the full description on the dataset page: https://huggingface.co/datasets/miguelcsx/babylm-2026-nexus-boundaries.babylm-2026-fr-92m-v2-eval-results