Datasetpublic

procmarco/fpabl1-arm-a-web-tokens-48k

fpabl1-arm-a-web-tokens-48k Pre-tokenized bins for the FinePhrase vs FineWeb ablation (fpabl1), arm fpabl1-a-web. Tokenizer: runs/mixed-tokenizer-48k/tokenizer (byte-BPE, 48k vocab; special ids bos=49119, eos=49120, pad=49121). Format: uint16 little-endian, 50 shards x 100,000,000 tokens = 5,000,000,000 tokens total. Boundary policy: source streams are already BOS/document/EOS packed; arm scheduler interleaves token chunks Source token composition: fw2_ita: 2,000,000,000… See the full description on the dataset page: https://huggingface.co/datasets/procmarco/fpabl1-arm-a-web-tokens-48k.

sourceHugging Faceotherupdated 3mo agoView on Hugging Face

0likes10downloads

root

file.gitattributes2 KBdownload

filemeta.json487 Bdownload

fileREADME.md724 Bdownload

filetokens_000000.bin190.7 MBdownload

filetokens_000001.bin190.7 MBdownload

filetokens_000002.bin190.7 MBdownload

filetokens_000003.bin190.7 MBdownload

filetokens_000004.bin190.7 MBdownload

filetokens_000005.bin190.7 MBdownload

filetokens_000006.bin190.7 MBdownload

filetokens_000007.bin190.7 MBdownload

filetokens_000008.bin190.7 MBdownload

filetokens_000009.bin190.7 MBdownload

filetokens_000010.bin190.7 MBdownload

filetokens_000011.bin190.7 MBdownload

filetokens_000012.bin190.7 MBdownload

filetokens_000013.bin190.7 MBdownload

filetokens_000014.bin190.7 MBdownload

filetokens_000015.bin190.7 MBdownload

filetokens_000016.bin190.7 MBdownload

filetokens_000017.bin190.7 MBdownload

filetokens_000018.bin190.7 MBdownload

filetokens_000019.bin190.7 MBdownload

filetokens_000020.bin190.7 MBdownload

filetokens_000021.bin190.7 MBdownload

filetokens_000022.bin190.7 MBdownload

filetokens_000023.bin190.7 MBdownload

filetokens_000024.bin190.7 MBdownload

filetokens_000025.bin190.7 MBdownload

filetokens_000026.bin190.7 MBdownload

filetokens_000027.bin190.7 MBdownload

filetokens_000028.bin190.7 MBdownload

filetokens_000029.bin190.7 MBdownload

filetokens_000030.bin190.7 MBdownload

filetokens_000031.bin190.7 MBdownload

filetokens_000032.bin190.7 MBdownload

filetokens_000033.bin190.7 MBdownload

filetokens_000034.bin190.7 MBdownload

filetokens_000035.bin190.7 MBdownload

filetokens_000036.bin190.7 MBdownload

filetokens_000037.bin190.7 MBdownload

filetokens_000038.bin190.7 MBdownload

filetokens_000039.bin190.7 MBdownload

filetokens_000040.bin190.7 MBdownload

filetokens_000041.bin190.7 MBdownload

filetokens_000042.bin190.7 MBdownload

filetokens_000043.bin190.7 MBdownload

filetokens_000044.bin190.7 MBdownload

filetokens_000045.bin190.7 MBdownload

filetokens_000046.bin190.7 MBdownload

filetokens_000047.bin190.7 MBdownload

filetokens_000048.bin190.7 MBdownload

filetokens_000049.bin190.7 MBdownload

procmarco/fpabl1-arm-a-web-tokens-48k · main · files are served by the source, never re-hosted here