LightSpeedUp/parameter-golf-data
Parameter Golf Competition Data Pre-tokenized FineWeb shards for the OpenAI Parameter Golf competition. Multiple SentencePiece vocab sizes plus a corrected byte-exact Scylla (TokenMonster) tokenization. Free checkpoint persistence API. Zero setup friction. ⚠️ Important: Scylla v1 Deprecated The original fineweb_scylla/ directory uses the 998-token vocab from PR #1143. That vocab's byte-accounting metadata treated TokenMonster tokens as context-free, which… See the full description on the dataset page: https://huggingface.co/datasets/LightSpeedUp/parameter-golf-data.
0692
../
fineweb_train_000000.bindownload
fineweb_train_000001.bindownload
fineweb_train_000002.bindownload
fineweb_train_000003.bindownload
fineweb_train_000004.bindownload
fineweb_train_000005.bindownload
fineweb_train_000006.bindownload
fineweb_train_000007.bindownload
fineweb_train_000008.bindownload
fineweb_train_000009.bindownload
fineweb_train_000010.bindownload
fineweb_train_000011.bindownload
fineweb_train_000012.bindownload
fineweb_train_000013.bindownload
fineweb_train_000014.bindownload
fineweb_train_000015.bindownload
fineweb_train_000016.bindownload
fineweb_train_000017.bindownload
fineweb_train_000018.bindownload
fineweb_train_000019.bindownload
fineweb_train_000020.bindownload
fineweb_train_000021.bindownload
fineweb_train_000022.bindownload
fineweb_train_000023.bindownload
fineweb_train_000024.bindownload
fineweb_train_000025.bindownload
fineweb_train_000026.bindownload
fineweb_train_000027.bindownload
fineweb_train_000028.bindownload
fineweb_train_000029.bindownload
fineweb_train_000030.bindownload
fineweb_train_000031.bindownload
fineweb_train_000032.bindownload
fineweb_train_000033.bindownload
fineweb_train_000034.bindownload
fineweb_train_000035.bindownload
fineweb_train_000036.bindownload
fineweb_train_000037.bindownload
fineweb_train_000038.bindownload
fineweb_train_000039.bindownload
fineweb_train_000040.bindownload
fineweb_train_000041.bindownload
fineweb_train_000042.bindownload
fineweb_train_000043.bindownload
fineweb_train_000044.bindownload
fineweb_train_000045.bindownload
fineweb_train_000046.bindownload
fineweb_train_000047.bindownload
fineweb_train_000048.bindownload
fineweb_train_000049.bindownload
fineweb_train_000050.bindownload
fineweb_train_000051.bindownload
fineweb_train_000052.bindownload
fineweb_train_000053.bindownload
fineweb_train_000054.bindownload
fineweb_train_000055.bindownload
fineweb_train_000056.bindownload
fineweb_train_000057.bindownload
fineweb_train_000058.bindownload
fineweb_train_000059.bindownload
fineweb_train_000060.bindownload
fineweb_train_000061.bindownload
fineweb_train_000062.bindownload
fineweb_train_000063.bindownload
fineweb_train_000064.bindownload
fineweb_train_000065.bindownload
fineweb_train_000066.bindownload
fineweb_train_000067.bindownload
fineweb_train_000068.bindownload
fineweb_train_000069.bindownload
fineweb_train_000070.bindownload
fineweb_train_000071.bindownload
fineweb_train_000072.bindownload
fineweb_train_000073.bindownload
fineweb_train_000074.bindownload
fineweb_train_000075.bindownload
fineweb_train_000076.bindownload
fineweb_train_000077.bindownload
fineweb_train_000078.bindownload
fineweb_train_000079.bindownload
fineweb_val_000000.bindownload