Hugodonotexit/dolma-en
Dolma-English Overview This dataset is a filtered subset of the Dolma corpus, restricted to English-only documents and further constrained by a minimum document length threshold. It is intended for training and evaluating large language models and other NLP systems that benefit from higher-quality, sufficiently long English text. The primary goals of this dataset are: To reduce multilingual and very short/noisy content present in the raw Dolma corpus. To provide… See the full description on the dataset page: https://huggingface.co/datasets/Hugodonotexit/dolma-en.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face