pt-sk/fineweb_edu_10B
This is the finewebedu dataset 10 Billion tokens. Tokenized using gpt-2 tokenizer. Each shards are a numpy file and contains 100 million tokens.
082
This repository belongs to pt-sk on Hugging Face.
CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.
fineweb_edu_10B
public
mit
no
pt-sk