venketh/SlimPajama-62B
Subset of cerebras/SlimPajama-627B, consisting of 10% of the train split and 100% of the test and validation splits. The train split consists of chunk2 from the original [cerebras/SlimPajama-627B] dataset, split into five zstd-compressed jsonl files for efficient loading. The dataset is 70 GB compressed, 249 GB uncompressed. @misc{cerebras2023slimpajama, author = {Soboleva, Daria and Al-Khateeb, Faisal and Myers, Robert and Steeves, Jacob R and Hestness, Joel and Dey, Nolan}… See the full description on the dataset page: https://huggingface.co/datasets/venketh/SlimPajama-62B.
Add README
Import train/chunk2 part 5 (5000-5xxx)
Import train/chunk2 part 3 (4000-5000)
Import train/chunk2 part 3 (3000-4000)
Import train/chunk2 part 2 (2000-3000)
Import train/chunk2 part 1 (1000-2000)
Import train/chunk2 part 0 (1-1000)
Import test and validation splits
initial commit