JackHsieh/statML-arxiv-40M-20M-olmo3

statML-arxiv-40M-20M-olmo3 An OLMo 3-tokenized re-windowing of JackHsieh/statML-arxiv-40M-20M (originally tokenized with Qwen3). Each row is a contiguous span of exactly 4096 tokens under the OLMo 3 tokenizer (allenai/Olmo-3-1025-7B, vocab 100 278), built to be as close as possible to the corresponding Qwen3 window of the same paper so the two corpora are comparable across tokenizers. The schema mirrors the ancestor dataset (leading columns), followed by re-windowing/difference… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/statML-arxiv-40M-20M-olmo3.