Datasetpublic

sinatras/fineweb10B-gpt2-fluxentropy

FineWeb Dataset - GPT-2 Tokenized This dataset contains preprocessed and tokenized FineWeb data using the GPT-2 tokenizer. It consists of multiple training folders containing the processed data. Dataset structure: fineweb_train_000001 to fineweb_train_000005: Training folders

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes23downloads

discussions and pull requests

Conversations for this repository live on Hugging Face.

CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.

Open discussions on Hugging Face