Datasetpublic

LightSpeedUp/parameter-golf-data

Parameter Golf Competition Data Pre-tokenized FineWeb shards for the OpenAI Parameter Golf competition. Multiple SentencePiece vocab sizes plus a corrected byte-exact Scylla (TokenMonster) tokenization. Free checkpoint persistence API. Zero setup friction. ⚠️ Important: Scylla v1 Deprecated The original fineweb_scylla/ directory uses the 998-token vocab from PR #1143. That vocab's byte-accounting metadata treated TokenMonster tokens as context-free, which… See the full description on the dataset page: https://huggingface.co/datasets/LightSpeedUp/parameter-golf-data.

sourceHugging Faceodc-byupdated 5mo agoView on Hugging Face

0likes692downloads

rootfineweb_sp4096

../

filefineweb_train_000000.bin140.0 MBdownload

filefineweb_train_000001.bin140.0 MBdownload

filefineweb_train_000002.bin139.4 MBdownload

filefineweb_train_000003.bin139.7 MBdownload

filefineweb_train_000004.bin140.0 MBdownload

filefineweb_train_000005.bin139.7 MBdownload

filefineweb_train_000006.bin139.6 MBdownload

filefineweb_train_000007.bin139.6 MBdownload

filefineweb_train_000008.bin139.9 MBdownload

filefineweb_train_000009.bin140.0 MBdownload

filefineweb_train_000010.bin140.0 MBdownload

filefineweb_train_000011.bin139.5 MBdownload

filefineweb_train_000012.bin139.7 MBdownload

filefineweb_train_000013.bin140.0 MBdownload

filefineweb_train_000014.bin139.9 MBdownload

filefineweb_train_000015.bin139.8 MBdownload

filefineweb_train_000016.bin139.7 MBdownload

filefineweb_train_000017.bin139.7 MBdownload

filefineweb_train_000018.bin139.7 MBdownload

filefineweb_train_000019.bin139.8 MBdownload

filefineweb_train_000020.bin139.9 MBdownload

filefineweb_train_000021.bin139.9 MBdownload

filefineweb_train_000022.bin139.7 MBdownload

filefineweb_train_000023.bin139.7 MBdownload

filefineweb_train_000024.bin139.6 MBdownload

filefineweb_train_000025.bin139.7 MBdownload

filefineweb_train_000026.bin139.9 MBdownload

filefineweb_train_000027.bin139.7 MBdownload

filefineweb_train_000028.bin139.6 MBdownload

filefineweb_train_000029.bin139.8 MBdownload

filefineweb_train_000030.bin140.0 MBdownload

filefineweb_train_000031.bin139.8 MBdownload

filefineweb_train_000032.bin139.9 MBdownload

filefineweb_train_000033.bin140.0 MBdownload

filefineweb_train_000034.bin140.0 MBdownload

filefineweb_train_000035.bin139.7 MBdownload

filefineweb_train_000036.bin139.7 MBdownload

filefineweb_train_000037.bin139.9 MBdownload

filefineweb_train_000038.bin139.8 MBdownload

filefineweb_train_000039.bin139.8 MBdownload

filefineweb_train_000040.bin139.9 MBdownload

filefineweb_train_000041.bin139.6 MBdownload

filefineweb_train_000042.bin139.9 MBdownload

filefineweb_train_000043.bin139.9 MBdownload

filefineweb_train_000044.bin139.8 MBdownload

filefineweb_train_000045.bin140.0 MBdownload

filefineweb_train_000046.bin139.8 MBdownload

filefineweb_train_000047.bin139.7 MBdownload

filefineweb_train_000048.bin139.7 MBdownload

filefineweb_train_000049.bin139.9 MBdownload

filefineweb_train_000050.bin140.0 MBdownload

filefineweb_train_000051.bin139.6 MBdownload

filefineweb_train_000052.bin139.5 MBdownload

filefineweb_train_000053.bin139.8 MBdownload

filefineweb_train_000054.bin139.6 MBdownload

filefineweb_train_000055.bin139.5 MBdownload

filefineweb_train_000056.bin139.7 MBdownload

filefineweb_train_000057.bin139.9 MBdownload

filefineweb_train_000058.bin139.7 MBdownload

filefineweb_train_000059.bin139.7 MBdownload

filefineweb_train_000060.bin139.8 MBdownload

filefineweb_train_000061.bin139.9 MBdownload

filefineweb_train_000062.bin139.9 MBdownload

filefineweb_train_000063.bin139.9 MBdownload

filefineweb_train_000064.bin139.6 MBdownload

filefineweb_train_000065.bin139.6 MBdownload

filefineweb_train_000066.bin139.6 MBdownload

filefineweb_train_000067.bin139.8 MBdownload

filefineweb_train_000068.bin139.8 MBdownload

filefineweb_train_000069.bin139.6 MBdownload

filefineweb_train_000070.bin139.5 MBdownload

filefineweb_train_000071.bin139.8 MBdownload

filefineweb_train_000072.bin139.9 MBdownload

filefineweb_train_000073.bin140.0 MBdownload

filefineweb_train_000074.bin139.9 MBdownload

filefineweb_train_000075.bin139.8 MBdownload

filefineweb_train_000076.bin139.8 MBdownload

filefineweb_train_000077.bin139.8 MBdownload

filefineweb_train_000078.bin139.9 MBdownload

filefineweb_train_000079.bin139.9 MBdownload

filefineweb_val_000000.bin86.8 MBdownload

LightSpeedUp/parameter-golf-data · main · files are served by the source, never re-hosted here