Datasetpublic

allenai/dolma3_mix-150B-1025

Dolma 3 Sample: 150B Mix Dataset Sources Sample of data for 1Bx5C and 7Bx1B. For the full Dolma 3 pool, see: https://huggingface.co/datasets/allenai/dolma3 Source Type Tokens Documents Common Crawl Web pages 121B (76.9%) 84.5M olmOCR Science PDFs Academic documents 19.9B (12.6%) 2.25M Stack-Edu (Rebalanced) GitHub code 11.1B (7.06%) 14.3M arXiv Papers with LaTeX 1.29B (0.82%) 247K FineMath 3+ Math web pages 4.10B (2.60%) 2.57M Wikipedia &… See the full description on the dataset page: https://huggingface.co/datasets/allenai/dolma3_mix-150B-1025.

sourceHugging Faceodc-byupdated 9mo agoView on Hugging Face

10likes7.9kdownloads

settings

This repository belongs to allenai on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namedolma3_mix-150B-1025

visibilitypublic

licenceodc-by

gatedno

ownerallenai

Account settings