Beetle-Data/sr-100M-pretok
Beetle-Data/sr-100M-pretok Pretokenized chunks (input_ids = 513-token packed sequences, no cross-document bleeding). Sharded incrementally; the marker data/_finalized.json is committed once all parts are uploaded.
08
Finalize: all parts uploaded
Add data/sr_clean_00006-00.parquet
Add data/sr_clean_00005-00.parquet
Add data/sr_clean_00004-00.parquet
Add data/sr_clean_00003-00.parquet
Add data/sr_clean_00002-00.parquet
Add data/sr_clean_00001-00.parquet
Add data/sr_clean_00000-00.parquet
initial commit