suleiman2003/W_hausa_v3
Cleaned Hausa Speech Dataset v3 A cleaned and processed Hausa speech dataset built from multiple open-source Hugging Face datasets. Dataset Description This dataset contains cleaned, normalized, and deduplicated Hausa speech audio with aligned transcriptions. All audio is: Sample rate: 16,000 Hz (mono) Format: FLAC (lossless, embedded in Parquet) Duration range: 1–30 seconds per clip Loudness normalized: -20 dBFS RMS VAD trimmed: Non-speech segments removed with… See the full description on the dataset page: https://huggingface.co/datasets/suleiman2003/W_hausa_v3.
Cleaned Hausa Speech Dataset v3
A cleaned and processed Hausa speech dataset built from multiple open-source Hugging Face datasets.
Dataset Description
This dataset contains cleaned, normalized, and deduplicated Hausa speech audio with aligned transcriptions. All audio is:
- Sample rate: 16,000 Hz (mono)
- Format: FLAC (lossless, embedded in Parquet)
- Duration range: 1–30 seconds per clip
- Loudness normalized: -20 dBFS RMS
- VAD trimmed: Non-speech segments removed with crossfaded joins
- Silence trimmed: Leading/trailing silence removed (25 dB threshold)
- Deduplicated: By audio content hash and (text, speaker_id) pairs
Sources
Dataset Structure
Features
audio: Audio waveform (FLAC, 16kHz mono)text: Hausa transcription (NFC-normalized Unicode)speaker_id: Integer speaker identifier (unique per source × speaker)
Usage
from datasets import load_dataset
dataset = load_dataset("suleiman2003/W_hausa_v3", split="train")
# Play first sample
print(dataset[0]["text"])
print(dataset[0]["audio"]["sampling_rate"]) # 16000Processing Pipeline
- Source Parquet files downloaded from HuggingFace Hub
- Audio decoded, resampled to 16kHz mono
- Silence trimming (25 dB threshold)
- WebRTC VAD trimming (aggressiveness=2) with 10ms crossfade
- RMS loudness normalization to -20 dBFS
- Quality filters: duration (1-30s), clipping ratio (<1%)
- Deduplication by audio hash and (text, speaker_id)
- FLAC encoding and Parquet sharding
