alexkstern/fineweb-nanochatbpe-50M
fineweb-nanochatbpe-50M FineWeb-Edu (from karpathy/fineweb-edu-100b-shuffle), pre-tokenized with the nanochatbpe tokenizer (vocab 65,536) and packaged as flat uint16 token-id .bin files for fast memmap training. This is a 50-million-token slice for data-constrained experiments. The train.bin is the byte-exact first 50,000,000 tokens (bytes [0, 100000000)) of the parent alexkstern/fineweb-nanochatbpe-20B train.bin. The val.bin is byte-identical to the parent's val.bin. file… See the full description on the dataset page: https://huggingface.co/datasets/alexkstern/fineweb-nanochatbpe-50M.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face