Datasetpublic

alexkstern/owt-gpt2bpe-local-9B

OpenWebText BPE bins used by the 400M replication runs (branch fixedinit-embed-init). train.bin ~9.03B tokens, val.bin ~4M tokens. Checksums in PROVENANCE.md5.

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes11downloads

Dataset Card

OpenWebText BPE bins used by the 400M replication runs (branch fixedinit-embed-init). train.bin ~9.03B tokens, val.bin ~4M tokens. Checksums in PROVENANCE.md5.