prometheus04/matilda-smollm-mix-15b-gpt2
matilda-smollm-mix-15B-gpt2 15 B GPT-2-BPE tokens drawn from a 5:1 token-balanced mix of HuggingFaceTB/smollm-corpus: Source Share Tokens fineweb-edu-dedup 83.33 % 12.50 B cosmopedia-v2 16.67 % 2.50 B Total: 15,000,349,569 tokens across 151 shards (shard_*.bin, uint16, 100 M tokens per shard). The full SmolLM recipe is 75 / 15 / 10 fineweb-edu / cosmopedia-v2 / python-edu. python-edu was dropped because the HuggingFaceTB/smollm-corpus subset ships only blob_id… See the full description on the dataset page: https://huggingface.co/datasets/prometheus04/matilda-smollm-mix-15b-gpt2.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face