BramVanroy/wikipedia_culturax_dutch
Filtered CulturaX + Wikipedia for Dutch This is a combined and filtered version of CulturaX and Wikipedia, only including Dutch. It is intended for the training of LLMs. Different configs are available based on the number of tokens (see a section below with an overview). This can be useful if you want to know exactly how many tokens you have. Great for using as a streaming dataset, too. Tokens are counted as white-space tokens, so depending on your tokenizer, you'll likely end… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/wikipedia_culturax_dutch.
Update README.md
Update README.md
Update README.md
Upload dataset (part 00028-of-00029)
Upload dataset (part 00027-of-00029)
Upload dataset (part 00026-of-00029)
Upload dataset (part 00025-of-00029)
Upload dataset (part 00024-of-00029)
Upload dataset (part 00023-of-00029)
Upload dataset (part 00022-of-00029)
Upload dataset (part 00021-of-00029)
Upload dataset (part 00020-of-00029)
Upload dataset (part 00019-of-00029)
Upload dataset (part 00018-of-00029)
Upload dataset (part 00017-of-00029)
Upload dataset (part 00016-of-00029)
Upload dataset (part 00015-of-00029)
Upload dataset (part 00014-of-00029)
Upload dataset (part 00013-of-00029)
Upload dataset (part 00012-of-00029)
Upload dataset (part 00011-of-00029)
Upload dataset (part 00010-of-00029)
Upload dataset (part 00009-of-00029)
Upload dataset (part 00008-of-00029)
Upload dataset (part 00007-of-00029)
Upload dataset (part 00006-of-00029)
Upload dataset (part 00005-of-00029)
Upload dataset (part 00004-of-00029)
Upload dataset (part 00003-of-00029)
Upload dataset (part 00002-of-00029)
Upload dataset (part 00001-of-00029)
Upload dataset (part 00000-of-00029)
Update README.md
Upload dataset (part 00025-of-00026)
Upload dataset (part 00024-of-00026)
Upload dataset (part 00023-of-00026)
Upload dataset (part 00022-of-00026)
Upload dataset (part 00021-of-00026)
Upload dataset (part 00020-of-00026)
Upload dataset (part 00019-of-00026)
Upload dataset (part 00018-of-00026)
Upload dataset (part 00017-of-00026)
Upload dataset (part 00016-of-00026)
Upload dataset (part 00015-of-00026)
Upload dataset (part 00014-of-00026)
Upload dataset (part 00013-of-00026)
Upload dataset (part 00012-of-00026)
Upload dataset (part 00011-of-00026)
Upload dataset (part 00010-of-00026)
Upload dataset (part 00009-of-00026)