JackHsieh/statML-arxiv-42M-11M-L-1024-llama32-pause7-injected

A pause-injected variant of JackHsieh/statML-arxiv-42M-11M-L-1024-llama32: every document token is preceded by a sentinel-wrapped stretch of pause tokens, so each row is exactly 8x longer (1_024 -> 8_192 tokens). Nothing else changes — same papers, same windows, same train/test split, same schema and column order as the parent. How it was derived For each row of the parent, the token sequence [t0, t1, ...] becomes: <|reserved_special_token_1|> <|reserved_special_token_0|> x5… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/statML-arxiv-42M-11M-L-1024-llama32-pause7-injected.