sradc/chunked-shuffled-wikipedia20220301en-bookcorpusopen
Dataset Card for "wikipedia20220301en-bookcorpusopen-chunked-shuffled" num_examples: 33.5 million download_size: 15.3 GB dataset_size: 26.1 GB This dataset combines wikipedia20220301.en and bookcorpusopen, and splits the data into smaller chunks, of size ~820 chars (such that each item will be at least ~128 tokens for the average tokenizer). The order of the items in this dataset has been shuffled, meaning you don't have to use dataset.shuffle, which is slower to iterate… See the full description on the dataset page: https://huggingface.co/datasets/sradc/chunked-shuffled-wikipedia20220301en-bookcorpusopen.
HuggyLingo Bot: Add language information to your dataset (#1)
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Upload README.md with huggingface_hub
Upload data/train-00052-of-00053-d5c59b24669d8f78.parquet with huggingface_hub
Upload data/train-00051-of-00053-7e5afe6363fab491.parquet with huggingface_hub
Upload data/train-00050-of-00053-ba02b582aee5e253.parquet with huggingface_hub
Upload data/train-00049-of-00053-6dbf18f335b7302c.parquet with huggingface_hub
Upload data/train-00048-of-00053-f415c41eb1d8c79d.parquet with huggingface_hub
Upload data/train-00047-of-00053-5223db06bee9f851.parquet with huggingface_hub
Upload data/train-00046-of-00053-4db1a5401edcf091.parquet with huggingface_hub
Upload data/train-00045-of-00053-5c07b994edef781f.parquet with huggingface_hub
Upload data/train-00044-of-00053-ff3d45ed018917b1.parquet with huggingface_hub
Upload data/train-00043-of-00053-8587ffa1c7b1cd89.parquet with huggingface_hub
Upload data/train-00042-of-00053-398fc610ec5b980c.parquet with huggingface_hub
Upload data/train-00041-of-00053-ad3ee1e36db18846.parquet with huggingface_hub
Upload data/train-00040-of-00053-0de88c5c96ce9f32.parquet with huggingface_hub
Upload data/train-00039-of-00053-6b769e558d050d3b.parquet with huggingface_hub
Upload data/train-00038-of-00053-3424b538308d455a.parquet with huggingface_hub
Upload data/train-00037-of-00053-3361ad9959599ff4.parquet with huggingface_hub
Upload data/train-00036-of-00053-d75a0f244ee5de2c.parquet with huggingface_hub
Upload data/train-00035-of-00053-4e1943bdff0be4e4.parquet with huggingface_hub
Upload data/train-00034-of-00053-55b3c0ffcd513b54.parquet with huggingface_hub
Upload data/train-00033-of-00053-43520498a9bae791.parquet with huggingface_hub
Upload data/train-00032-of-00053-c717ca9cba02f1b0.parquet with huggingface_hub
Upload data/train-00031-of-00053-e169a61caa31af7a.parquet with huggingface_hub
Upload data/train-00030-of-00053-8296bf51ebae867c.parquet with huggingface_hub
Upload data/train-00029-of-00053-947c222f8d60b395.parquet with huggingface_hub
Upload data/train-00028-of-00053-de2e6940e76d5489.parquet with huggingface_hub
Upload data/train-00027-of-00053-0f40722e1139af97.parquet with huggingface_hub
Upload data/train-00026-of-00053-ad757960ef07e417.parquet with huggingface_hub
Upload data/train-00025-of-00053-79d1d53232016cb8.parquet with huggingface_hub
Upload data/train-00024-of-00053-e33f094803749666.parquet with huggingface_hub
Upload data/train-00023-of-00053-03540d6c605f5916.parquet with huggingface_hub
Upload data/train-00022-of-00053-69c50557ce189b1c.parquet with huggingface_hub
Upload data/train-00021-of-00053-fdbf833bb63c6505.parquet with huggingface_hub
Upload data/train-00020-of-00053-5ae0aa4b616094ea.parquet with huggingface_hub
Upload data/train-00019-of-00053-84088b73397c1689.parquet with huggingface_hub
Upload data/train-00018-of-00053-67e33a62a93cfec0.parquet with huggingface_hub
Upload data/train-00017-of-00053-ed0674091008807a.parquet with huggingface_hub
Upload data/train-00016-of-00053-5e1de5c05c300b83.parquet with huggingface_hub
Upload data/train-00015-of-00053-a26e2762865ab80a.parquet with huggingface_hub
Upload data/train-00014-of-00053-c47af6426c3d43d1.parquet with huggingface_hub
Upload data/train-00013-of-00053-248deb0b615b91d8.parquet with huggingface_hub
Upload data/train-00012-of-00053-8569267e5b36341b.parquet with huggingface_hub
Upload data/train-00011-of-00053-54d977e0f1b17a44.parquet with huggingface_hub