tachytelicdetonation/ncp-1p6b-mix
ncp-1p6b-mix Packed uint16 token stream for NCP-64M pretraining (1,601,363,502 tokens). Mix (token-weighted, deficit-scheduled interleave) finepdfs (codelion/finepdfs-1B): 45.5% — 729M tok dclm (codelion/dclm-baseline-1B): 26.8% — 428M tok fineweb_edu (codelion/fineweb-edu-1B): 18.0% — 287M tok sutra (codelion/sutra-improved-100M): 10.1% — 162M tok Backbone follows the 70M-scale recipe from https://huggingface.co/blog/codelion/optimal-dataset-mixing (50/30/20… See the full description on the dataset page: https://huggingface.co/datasets/tachytelicdetonation/ncp-1p6b-mix.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face