sinatras/fineweb10B-gpt2-fluxentropy
FineWeb Dataset - GPT-2 Tokenized This dataset contains preprocessed and tokenized FineWeb data using the GPT-2 tokenizer. It consists of multiple training folders containing the processed data. Dataset structure: fineweb_train_000001 to fineweb_train_000005: Training folders
023
This repository belongs to sinatras on Hugging Face.
CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.
fineweb10B-gpt2-fluxentropy
public
not set
no
sinatras