datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
central-kurdish-pseudolabel
Central Kurdish → English Pseudo-Labeled Speech Translation Corpus
Dataset Summary
This repository contains a large-scale pseudo-labeled speech translation corpus for Central Kurdish (Sorani Kurdish).
The dataset was automatically generated using a pipeline composed of:
Speech segmentation
Automatic Speech Recognition (ASR)
Machine Translation (MT)
The objective is to provide training data for end-to-end Speech-to-Text Translation (S2TT) in a language with very… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/central-kurdish-pseudolabel.northern-kurdish-raw-audio
Northern Kurdish Raw Audio Collection
Overview
This repository contains a large collection of raw Northern Kurdish (Kurmanji Kurdish) speech recordings gathered from publicly available Kurdish media sources.
The collection was assembled to support research and development in:
Automatic Speech Recognition (ASR)
Speech Translation (ST)
Text-to-Speech (TTS)
Self-supervised Learning (SSL)
Spoken Language Understanding (SLU)
The dataset contains more than 2,000 hours… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/northern-kurdish-raw-audio.kurdish-wikipedia-articles
Summary
Extracted from the wikidump. There are summaries and categories available for each article. Will look into adding them later.
Usage
from datasets import load_dataset
ds = load_dataset("nazimali/kurdish-wikipedia-articles", split="train")
ds
Dataset({
features: ['id', 'url', 'title', 'text'],
num_rows: 63076
})
kurdish-english-opus-100
Summary
Extracted subset from Helsinki-NLP/opus-100 and reshaped it into 2 columns. Note: noticed some low quality pairs. It would be a good project to classify and select high quality pairs.
Usage
from datasets import load_dataset
ds = load_dataset("nazimali/kurdish-english-opus-100", split="train")
ds
Dataset({
features: ['english', 'kurdish'],
num_rows: 148844
})
northern-kurdish-pseudolabel
Northern Kurdish Raw Audio Collection
Dataset Summary
This repository contains a large collection of raw Northern Kurdish (Kurmanji Kurdish) speech recordings gathered from publicly available Kurdish media sources.
The corpus was assembled to support research and development in:
Automatic Speech Recognition (ASR)
Speech Translation (ST)
Text-to-Speech (TTS)
Self-Supervised Learning (SSL)
Spoken Language Understanding (SLU)
Low-Resource Speech Processing
The… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/northern-kurdish-pseudolabel.southern-kurdish-raw-audio
Southern Kurdish Raw Audio Collection
Overview
This repository contains approximately 170 hours of Southern Kurdish (SDH) raw speech collected from publicly available media sources, podcasts, interviews, news broadcasts, and online programs.
The main sources are Aryen TV and Kurd Channel.
The recordings mainly consist of spontaneous and semi-spontaneous speech, covering diverse speakers, topics, and acoustic conditions. While the majority of the content is… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/southern-kurdish-raw-audio.Kurdish-Underwater-Basketweaving-Forum
KaraKaraWitch/Kurdish-Underwater-Basketweaving-Forum
Yes this is a 4chan dataset. THIS CONTAINS TOXIC SHIT like (/POL/) content. YOU HAVE BEEN WARNED.
KaraKaraWitch & their company dissolves all responsbilities when using this dataset.
Text Sample
Note: namedconversation is a modification of OAI's conversation format. While identical, namedconversation is not required to stick to system,user,model/assistant verbs. This allows for a much more varied use… See the full description on the dataset page: https://huggingface.co/datasets/KaraKaraWitch/Kurdish-Underwater-Basketweaving-Forum.central-kurdish-audiobook-raw
Central Kurdish Audiobook Raw Audio Collection
Overview
This repository contains a large collection of raw Central Kurdish (Sorani Kurdish) audiobook recordings gathered from publicly available online sources.
The collection was assembled to support research and development in:
Automatic Speech Recognition (ASR)
Speech Translation (ST)
Text-to-Speech (TTS)
Self-supervised learning
The dataset contains approximately 4,300 hours of speech collected from 1026… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/central-kurdish-audiobook-raw.central-kurdish-raw-audiocentral-kurdish-tts4all
TTS4All Central Kurdish Speech Dataset
Dataset Summary
The TTS4All Central Kurdish Speech Dataset is a multi-speaker speech corpus developed for speech synthesis and speech technology research in Central Kurdish (Sorani Kurdish).
The dataset was created within the TTS4All initiative during the JSALT 2025 Workshop and provides more than 35 hours of transcribed speech from three native Central Kurdish speakers.
The corpus was designed to support:
Text-to-Speech… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/central-kurdish-tts4all.kurdish-kurmanji-news
Kurdish Kurmanji News Dataset
⚠️ A newer, higher-quality version of this dataset is available
kurdish-web is a significantly improved and more professional version of this dataset.
Better collection methodology: More robust scraping instead of custom per-site CSS selectors
Higher text quality: Much cleaner Kurdish text with significantly reduced non-Kurdish / mixed-language noise
Multi-dialect coverage: Includes both Kurmanji (kmr_Latn) and Sorani (ckb_Arab)… See the full description on the dataset page: https://huggingface.co/datasets/muzaffercky/kurdish-kurmanji-news.KurdishSentimentClassification
KurdishSentimentClassification
An MTEB dataset
Massive Text Embedding Benchmark
Kurdish Sentiment Dataset
Task category
t2c
Domains
Web, Written
Reference
https://link.springer.com/article/10.1007/s10579-023-09716-6
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["KurdishSentimentClassification"])
evaluator = mteb.MTEB(task)
model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/KurdishSentimentClassification.hawrami-kurdish-raw-audio
Hawrami Raw Audio Collection
Overview
This repository contains approximately 500 hours of Hawrami Kurdish raw speech collected from publicly available media sources.
The dataset was gathered primarily from the Rocyar program broadcast on Sterk TV, along with additional publicly available Hawrami-language content.
The recordings mainly consist of spontaneous and semi-spontaneous speech, including interviews, discussions, cultural programs, storytelling, and other… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/hawrami-kurdish-raw-audio.kurdish-web
Dataset Card for Kurdish Web Corpus (Deduplicated)
Dataset Summary
A multilingual corpus of web text in three Kurdish/Zaza varieties — Kurmanji Kurdish
(kmr_Latn), Sorani Kurdish (ckb_Arab), and Zazaki (diq_Latn) — scraped from Kurdish-language
websites, language-identified with GlotLID, and
deduplicated (exact + MinHash near-duplicate removal). See the "Dataset Creation" section below
for the full pipeline.
Rows, by language config:
config
language
script… See the full description on the dataset page: https://huggingface.co/datasets/muzaffercky/kurdish-web.kurdish-news-headlines
Dataset Card for Kurdish News Dataset Headlines (KNDH)
Summary
Description from the paper: the Kurdish language belongs to the Indo-Iranian family of Indo-European languages. It is well-known to be a close relative to the Persian language. The speakers span the intersections of Iran, Turkey, Iraq, and Syria. The Kurdish language is one of the official languages in Iraq and has regional status in Iran. The language has 40 million speakers [2,11].
Usage
from… See the full description on the dataset page: https://huggingface.co/datasets/nazimali/kurdish-news-headlines.northern-kurdish-fleurs
FLEURS-Kobani: Northern Kurdish Speech Benchmark
📌 Description
FLEURS-Kobani is a speech dataset for Northern Kurdish (Kurmanji, ISO 639-3: KMR), designed as an extension of the FLEURS benchmark.
Automatic Speech Recognition (ASR)
Speech-to-Text Translation (S2TT)
Speech-to-Speech Translation (S2ST)
Dataset Summary
Language: Northern Kurdish (Kurmanji, KMR)
Total utterances: 5,162
Total duration: 18h 24m
Speakers: 31 native speakers
26 female
5 male… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/northern-kurdish-fleurs.KurdishPoetryMeterClassification
Kurdish Poetry Meter Classification
Multi-class meter (prosody) classification of Central Kurdish poetry for PoetryMTEB embedding evaluation.
Derived from the VejinBooks Poem Dataset (AsoSoft): expert-annotated meter and form tags for poems from vejinbooks. Used in automatic Kurdish meter identification research (Mahmudi & Veisi, PLOS ONE 2023).
Dataset Card
Item
Description
Dataset version (PoetryMTEB)
1.0.0
Source (GitHub)… See the full description on the dataset page: https://huggingface.co/datasets/PoetryMTEB/KurdishPoetryMeterClassification.Legacy-Kurdish-Asian-Underwater-Basketweaving-Forum
Your dataset license is now voided
KaraKaraWitch & their respective company shall not be held responsible for any spicy content in this dataset, thermonuclear war or getting stampeded because you used this dataset in your model.
Please do some research if you have any concerns about the content included in this dataset before downloading it!
YOU are choosing to analyze this data, and if you blame me for your newfound addiction to obscure memes, I will just assume you were… See the full description on the dataset page: https://huggingface.co/datasets/KaraKaraWitch/Legacy-Kurdish-Asian-Underwater-Basketweaving-Forum.Kurdish_Llama3_Processed_V1kurdish-corpus
Kurdish Corpus
A large-scale multi-source Kurdish language dataset for training language models.
Dataset Statistics
Total Documents: 1,797,686
Total Tokens: 625,716,980
Shards: 4
Built: 2026-05-02
By Language
Language
Documents
Sorani (ckb)
1,274,425
Kurmanji (kmr)
478,540
Zazaki (diq)
34,069
Hawrami (hac)
10,652
By Source Type
Source Type
Documents
News
1,443,750
Web
229,705
Wikipedia
124,231
Usage… See the full description on the dataset page: https://huggingface.co/datasets/kurdish-ai/kurdish-corpus.kurdish-grammar-eval
Kurdish Grammar Minimal Pairs (BLiMP-style) — Kurmancî · Soranî
A grammar-competence benchmark for Kurdish, built on the BLiMP
idea: for each item, a correct sentence is paired with a corrupted version where one specific
grammar rule has been deliberately broken. Score a language model by checking whether it assigns higher
likelihood to the correct sentence than the corrupted one — accuracy well above 50% means the model
learned the rule, not just surface fluency.
Built by… See the full description on the dataset page: https://huggingface.co/datasets/kurdish-tech/kurdish-grammar-eval.kurdish-kurmanji-grammar-error-correctionThis dataset is for developing and evaluating grammatical error correction (GEC) models,
like Grammarly, for Kurdish Kurmanji. Incorrect sentences were manually collected
from YouTube comment sections of Kurdish videos and X(Twitter) and Muzaffer Cıkay added their corrections.
The source videos are documented in the source.txt file.
Usage
from datasets import load_dataset
dataset = load_dataset("muzaffercky/kurdish-kurmanji-typo-correction", split="train")
print(dataset)
southern-kurdish-asr
Bestun: Southern Kurdish speech recognition resources and benchmarking
This repository provides speech recognition (ASR) resources for Southern Kurdish (ISO 639-3: sdh), a threatened variant of the Kurdish macrolanguage.It includes:
Bestun training corpus: ~30 hours of manually validated read speech
Evaluation benchmark: 773 validated utterances (86.74 minutes) recorded by 8 speakers from different Southern Kurdish vernacular regions
The dataset and models are released under CC… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/southern-kurdish-asr.kurdish-multidialect-asr-benchmark
Kurdish Dialect Speech Corpus
This project aims to provide a multi-dialect speech recognition benchmark for the Kurdish language. The Central Kurdish portion is the same as the Asosoft benchmark. The sentences were originally written in Central Kurdish (CKB), translated into other Kurdish dialects, and then recorded by native speakers.
The current version includes three Kurdish dialects: Central Kurdish, Northern Kurdish, and Southern Kurdish. A Hawrami version and the Badini… See the full description on the dataset page: https://huggingface.co/datasets/aranemini/kurdish-multidialect-asr-benchmark.Kurdishcorpus
KurCorpus 2B
KurCorpus 2B is a multidialectal Kurdish text corpus (>2B tokens) for large-scale language modeling and downstream NLP.
Dialects:Sorani (ckb), Kurmanji/Badini (kmr), Hawrami/Gorani (hac)
License: CC BY 4.0
Repo: https://huggingface.co/datasets/abdulhade/Kurdishcorpus
External record: Mendeley Data DOI 10.17632/fb5xhhn6m5.1
TL;DR
Ready for pretraining and finetuning Kurdish LMs
Single field text (UTF-8), offered as large archives or sharded… See the full description on the dataset page: https://huggingface.co/datasets/abdulhade/Kurdishcorpus.kurdish-bidirectional-translation-v2Kurdish-Asian-Underwater-Basketweaving-Forum
Your dataset license is now voided
KaraKaraWitch & their respective company shall not be held responsible for any spicy content in this dataset, thermonuclear war or getting stampeded because you used this dataset in your model.
Please do some research if you have any concerns about the content included in this dataset before downloading it!
YOU are choosing to analyze this data, and if you blame me for your newfound addiction to obscure memes, I will just assume you were… See the full description on the dataset page: https://huggingface.co/datasets/KaraKaraWitch/Kurdish-Asian-Underwater-Basketweaving-Forum.Kurdish-Sorani-Parallel-Corpuskurdish-latin-wikipedia-sentences
Kurdish Latin Wikipedia Sentences Dataset
This dataset consists of 78,004 Kurdish sentences extracted from Wikipedia. All sentences are written in Latin script and consist of 12 to 18 words. The dataset has been carefully cleaned to remove numbers, dates, or non-textual elements.
Dataset Highlights
Source: Wikipedia (Kurdish content)
Script: Kurdish Latin
Content: Pure textual sentences (no numbers, dates, or special characters)
Sentence Length: 12 to 18 words per… See the full description on the dataset page: https://huggingface.co/datasets/zinaro/kurdish-latin-wikipedia-sentences.Kurdish-AI-Chat-Dataset-V1
Dataset Card for "Kurdish-AI-Chat-Dataset-V1"
More Information needed