Datasetpublic

akhilhsingh/homeo-dataset

🍷 FineWeb 15 trillion tokens of the finest data the 🌐 web has to offer What is it? The 🍷 FineWeb dataset consists of more than 15T tokens of cleaned and deduplicated english web data from CommonCrawl. The data processing pipeline is optimized for LLM performance and ran on the 🏭 datatrove library, our large scale data processing library. 🍷 FineWeb was originally meant to be a fully open replication of 🦅 RefinedWeb, with a release of the full… See the full description on the dataset page: https://huggingface.co/datasets/akhilhsingh/homeo-dataset.

sourceHugging Faceodc-byupdated 2y agoView on Hugging Face

1likes2.6kdownloads

settings

This repository belongs to akhilhsingh on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namehomeo-dataset

visibilitypublic

licenceodc-by

gatedno

ownerakhilhsingh

Account settings