Datasetpublic

alexkstern/owt-gpt2bpe-local-9B

OpenWebText BPE bins used by the 400M replication runs (branch fixedinit-embed-init). train.bin ~9.03B tokens, val.bin ~4M tokens. Checksums in PROVENANCE.md5.

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes9downloads

root

file.gitattributes2 KBdownload

filePROVENANCE.md5311 Bdownload

fileREADME.md159 Bdownload

filetrain.bin16.82 GBdownload

fileval.bin7.8 MBdownload

alexkstern/owt-gpt2bpe-local-9B · main · files are served by the source, never re-hosted here