swan07/math-tiers
Math-Tiers: A Tiered Pretraining Corpus for Studying Numerical Reasoning A large-scale English pretraining corpus split into three tiers by mathematical content density. Designed for controlled experiments studying how data composition during pretraining affects numerical reasoning in language models. Tiers Tier Description Shards Size Est. Tokens Sources T0 Pure narrative: no digits, number words, or math 648 542 GB ~113B RedPajama-Book… See the full description on the dataset page: https://huggingface.co/datasets/swan07/math-tiers.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face