google/wiki40b
Dataset Card for "wiki40b" Dataset Summary Clean-up text for 40+ Wikipedia languages editions of pages correspond to entities. The datasets have train/dev/test splits per language. The dataset is cleaned up by page filtering to remove disambiguation pages, redirect pages, deleted pages, and non-entity pages. Each example contains the wikidata id of the entity, and the full Wikipedia article after page processing that removes non-content sections and structured… See the full description on the dataset page: https://huggingface.co/datasets/google/wiki40b.
3711k
../
test-00000-of-00002.parquetdownload
test-00001-of-00002.parquetdownload
train-00000-of-00029.parquetdownload
train-00001-of-00029.parquetdownload
train-00002-of-00029.parquetdownload
train-00003-of-00029.parquetdownload
train-00004-of-00029.parquetdownload
train-00005-of-00029.parquetdownload
train-00006-of-00029.parquetdownload
train-00007-of-00029.parquetdownload
train-00008-of-00029.parquetdownload
train-00009-of-00029.parquetdownload
train-00010-of-00029.parquetdownload
train-00011-of-00029.parquetdownload
train-00012-of-00029.parquetdownload
train-00013-of-00029.parquetdownload
train-00014-of-00029.parquetdownload
train-00015-of-00029.parquetdownload
train-00016-of-00029.parquetdownload
train-00017-of-00029.parquetdownload
train-00018-of-00029.parquetdownload
train-00019-of-00029.parquetdownload
train-00020-of-00029.parquetdownload
train-00021-of-00029.parquetdownload
train-00022-of-00029.parquetdownload
train-00023-of-00029.parquetdownload
train-00024-of-00029.parquetdownload
train-00025-of-00029.parquetdownload
train-00026-of-00029.parquetdownload
train-00027-of-00029.parquetdownload
train-00028-of-00029.parquetdownload
validation-00000-of-00002.parquetdownload
validation-00001-of-00002.parquetdownload