blab-jhu/KYS-DCLM-Refinedweb-100M-Scored

KYS-DCLM-Refinedweb-100M-Scored The candidate document pool behind Know Your Sources: Data Selection Matters when Rewriting for Data-Constrained Pretraining — 99,949,162 web documents sampled from DCLM-RefinedWeb, each annotated with three independent quality scores, their tie-aware global percentiles, a 24-way WebOrganizer topic label, and a Llama-2 token count. Every source-selection strategy in the paper is a different way of ranking this table. Contents 200… See the full description on the dataset page: https://huggingface.co/datasets/blab-jhu/KYS-DCLM-Refinedweb-100M-Scored.