chinese-babylm-org/babylm-zho-100M
babylm-zho-100M A filtered version of BabyLM-community/babylm-zho, a Chinese-language corpus designed for the BabyLM Challenge. This is the official training data for Chinese BabyLM Challenge. Size The filtered dataset contains approximately 101,343,320 tokens (tokenized with jieba). Modifications The original babylm-zho dataset was filtered to reduce the proportion of speech-derived text. Specifically, 1/2 of the entries sourced from WenetSpeech… See the full description on the dataset page: https://huggingface.co/datasets/chinese-babylm-org/babylm-zho-100M.
babylm-zho-100M
A filtered version of BabyLM-community/babylm-zho, a Chinese-language corpus designed for the BabyLM Challenge. This is the official training data for Chinese BabyLM Challenge.
Size
The filtered dataset contains approximately 101,343,320 tokens (tokenized with jieba).
Modifications
The original babylm-zho dataset was filtered to reduce the proportion of speech-derived text. Specifically, 1/2 of the entries sourced from WenetSpeech were removed. All other entries are retained unchanged.
Dataset Fields
Source Dataset
- Original dataset: BabyLM-community/babylm-zho
- Filtering script:
filter_and_upload_babylm_zho.py
Cite
Please cite the following paper if you are using this dataset.
@inproceedings{jumelet2026babybabellm,
title={Babybabellm: A multilingual benchmark of developmentally plausible training data},
author={Jumelet, Jaap and Fourtassi, Abdellah and Haga, Akari and Bunzeck, Bastian and Shandilya, Bhargav and Galvan-Sosa, Diana and Haznitrama, Faiz Ghifari and Padovani, Francesca and Meyer, Francois and Hu, Hai and others},
booktitle={Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)},
pages={3297--3329},
year={2026}
}