CoolFace
Datasetpublic

YangZhoumill/openwebtext-presplit

Fixed OpenWebText train/test split This is an untokenized, deterministic shuffle of Skylion007/openwebtext pinned at commit 79d93d786212f7344586290adb811d4ae6a1762c. It contains the original columns without transformation. The shuffle seed is 2357. The test set is the first 0.05% of shuffled rows (rounded to the nearest whole document); all remaining rows are training data. Exact counts and SHA-256 checksums are in split_manifest.json.

sourceHugging Faceupdated 19d agoView on Hugging Face
0likes271downloads

YangZhoumill/openwebtext-presplit · main · files are served by the source, never re-hosted here