Datasetpublic

Ba2han/fineweb-2-turkish-categorized-long

altaidevorg/fineweb-2-turkish-categorized long filtered Turkish texts Source: altaidevorg/fineweb-2-turkish-categorized (config: default). The script streamed 10,000,000 raw source rows before stopping. Categories ads, adult content, sports, tabloid were rejected before length and quality filtering. Retained rows contain 3,000–16,500 characters and passed the iteration-5 Turkish language, repetition, glue-word, punctuation, SEO, and soft information-density filters. Selected… See the full description on the dataset page: https://huggingface.co/datasets/Ba2han/fineweb-2-turkish-categorized-long.

sourceHugging Faceupdated 2mo agoView on Hugging Face

0likes135downloads

Dataset Card

altaidevorg/fineweb-2-turkish-categorized long filtered Turkish texts

Source: altaidevorg/fineweb-2-turkish-categorized (config: default).

The script streamed 10,000,000 raw source rows before stopping. Categories ads, adult content, sports, tabloid were rejected before length and quality filtering.

Retained rows contain 3,000–16,500 characters and passed the iteration-5 Turkish language, repetition, glue-word, punctuation, SEO, and soft information-density filters. Selected rows: 461,180.

Generated by process_fineweb_10m.py. See summary.json for counts and thresholds.