humair025/Urdu-ONYX-WAV-kanade-Annotated

Urdu-ONYX-WAV-real-Annotated

Enhanced version of Urdu-ONYX-WAV-real with phoneme annotations and Kanade tokenizer features.

Dataset Statistics

• —Total Samples: 26,217
• —Total Duration: 42.77 hours
• —Average Duration: 5.87 seconds
• —Duration Range: 0.65s - 122.23s
• —Average Phonemes: 18.5 per sample
• —Average Kanade Tokens: 151.1 per sample
• —Global Embedding Dimension: 128

New Columns

This dataset adds the following columns:

1. 1.duration (float): Audio duration in seconds
2. 2.phonemes (string): IPA phonemes with stress markers (space-separated)
3. 3.phonemes_no_stress (string): IPA phonemes without stress markers
4. 4.phonemes_list (list): List of individual phonemes with stress
5. 5.phoneme_count (int): Number of phonemes
6. 6.content_token_indices (list): Kanade content token indices
7. 7.global_embedding (list): Kanade global embedding vector
8. 8.token_len (int): Length of content token sequence

Note: The audio column has been removed to reduce dataset size.

Generated By

• —Phonemes: urdu-g2p
• —Kanade Features: kanade-12.5hz
• —Processing: CUDA-accelerated on GPU
• —Processing Date: 2026-01-28

Usage

from datasets import load_dataset

dataset = load_dataset("humair025/Urdu-ONYX-WAV-kanade-Annotated")

# Example sample
sample = dataset['train'][0]
print(f"Text: {sample['transcript']}")
print(f"Duration: {sample['duration']:.2f}s")
print(f"Phonemes: {sample['phonemes']}")
print(f"Token length: {sample['token_len']}")
print(f"Global embedding shape: {len(sample['global_embedding'])}")

Original Dataset

Based on Urdu-ONYX-WAV-real

License

MIT License