Datasetpublic

alexkstern/owt-gpt2bpe-local-9B

OpenWebText BPE bins used by the 400M replication runs (branch fixedinit-embed-init). train.bin ~9.03B tokens, val.bin ~4M tokens. Checksums in PROVENANCE.md5.

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes9downloads

5 commits on main

8714f6b1mo ago

Upload PROVENANCE.md5 with huggingface_hub

alexkstern

de773f11mo ago

Upload val.bin with huggingface_hub

alexkstern

b9cc8c81mo ago

Upload train.bin with huggingface_hub

alexkstern

dcda0981mo ago

Upload README.md with huggingface_hub

alexkstern

401b78f1mo ago

initial commit

alexkstern