CoolFace
Datasetpublic

YangZhoumill/openwebtext-presplit

Fixed OpenWebText train/test split This is an untokenized, deterministic shuffle of Skylion007/openwebtext pinned at commit 79d93d786212f7344586290adb811d4ae6a1762c. It contains the original columns without transformation. The shuffle seed is 2357. The test set is the first 0.05% of shuffled rows (rounded to the nearest whole document); all remaining rows are training data. Exact counts and SHA-256 checksums are in split_manifest.json.

sourceHugging Faceupdated 18d agoView on Hugging Face
0likes269downloads
Dataset Card

Fixed OpenWebText train/test split

This is an untokenized, deterministic shuffle of `Skylion007/openwebtext` pinned at commit 79d93d786212f7344586290adb811d4ae6a1762c. It contains the original columns without transformation.

The shuffle seed is 2357. The test set is the first 0.05% of shuffled rows (rounded to the nearest whole document); all remaining rows are training data. Exact counts and SHA-256 checksums are in split_manifest.json.