Datasetpublic

turkish-nlp-suite/temiz-Wiki

A cleaned version of Turkish Wikipedia dataset. The soource is wikimedia/wikipedia repo. The text is cleaned throughoutly, first of all we eliminated text that are shorter than a predetermined threshold of words and characters. Then we normalized with NFKC, cleaned some non-ASCII chars and normalized whitespaces.

sourceHugging Facecc-by-sa-4.0updated 7mo agoView on Hugging Face

4likes65downloads

12 commits on main

80f30fe7mo ago

minor

BayanDuygu

a9ef5f58mo ago

Update README.md

BayanDuygu

31d01d88mo ago

Update README.md

BayanDuygu

749afc88mo ago

Upload data/train/wiki_3.jsonl with huggingface_hub

BayanDuygu

47ed62a8mo ago

Upload data/train/wiki_2.jsonl with huggingface_hub

BayanDuygu

71475cb8mo ago

Upload data/train/wiki_1.jsonl with huggingface_hub

BayanDuygu

3fa7b438mo ago

Upload data/train/wiki_0.jsonl with huggingface_hub

BayanDuygu

45750a28mo ago

Upload data/train/wiki_3.jsonl with huggingface_hub

BayanDuygu

f193e918mo ago

Upload data/train/wiki_2.jsonl with huggingface_hub

BayanDuygu

2bdf4568mo ago

Upload data/train/wiki_1.jsonl with huggingface_hub

BayanDuygu

40bf9188mo ago

Upload data/train/wiki_0.jsonl with huggingface_hub

BayanDuygu

a86ada78mo ago

initial commit

BayanDuygu