Hugodonotexit/dolma-en

Dolma-English Overview This dataset is a filtered subset of the Dolma corpus, restricted to English-only documents and further constrained by a minimum document length threshold. It is intended for training and evaluating large language models and other NLP systems that benefit from higher-quality, sufficiently long English text. The primary goals of this dataset are: To reduce multilingual and very short/noisy content present in the raw Dolma corpus. To provide… See the full description on the dataset page: https://huggingface.co/datasets/Hugodonotexit/dolma-en.