chinese-babylm-org/babylm-zho-100M
babylm-zho-100M A filtered version of BabyLM-community/babylm-zho, a Chinese-language corpus designed for the BabyLM Challenge. This is the official training data for Chinese BabyLM Challenge. Size The filtered dataset contains approximately 101,343,320 tokens (tokenized with jieba). Modifications The original babylm-zho dataset was filtered to reduce the proportion of speech-derived text. Specifically, 1/2 of the entries sourced from WenetSpeech… See the full description on the dataset page: https://huggingface.co/datasets/chinese-babylm-org/babylm-zho-100M.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face