CoolFace
Datasetpublic

sfanm/d24-midtrain-olmo3-5b

d24 Midtrain — OLMo-3 Dolmino (5B, chunked) A 5.00B-token reproduction of OLMo 3's Dolma-3 Dolmino mid-train mix, built by taking a fraction of each component of allenai/dolma3_dolmino_mix-100B-1025. Unlike the smaller d24-midtrain-olmo3 (which dropped documents over 2048 tokens — silently zeroing the long reasoning-trace and PDF components), this build chunks long documents into 2048-token windows (decoded back to text), so every component keeps ~100% of its tokens and reaches… See the full description on the dataset page: https://huggingface.co/datasets/sfanm/d24-midtrain-olmo3-5b.

sourceHugging Faceotherupdated 3mo agoView on Hugging Face
0likes344downloads

sfanm/d24-midtrain-olmo3-5b · main · files are served by the source, never re-hosted here