Modelpublic

KasuleTrevor/cdli-qwen3-asr-en-uganda-severity-disorder

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes10downloads

Model Card

CDLI Qwen3-ASR English Experiment 4

Uganda-only severity + disorder prompt fine-tune for atypical English speech.

—Prompt mode: metadata
—Output dir: qwen3-asr-en-uganda-severity-disorder
—Selected checkpoint: checkpoint-1941
—Selection reason: latest checkpoint fallback

Evaluation Results

Overall Metrics

—Corpus WER (normalized): 0.2199
—Corpus CER (normalized): 0.1341
—Avg utterance WER (normalized): 0.2117
—Avg utterance CER (normalized): 0.1325

Severity Breakdown

severity_speech_impairment	n_samples	n_speakers	avg_wer	avg_cer	median_wer	median_cer	corpus_wer_normalized	corpus_cer_normalized
Severe (frequent breakdowns)	339	3	0.226476	0.154034	0.191489	0.12069	0.23014	0.155355
Moderate (requires effort to understand)	340	3	0.216902	0.130821	0.1875	0.105921	0.209003	0.124688
Mild (easily understood with minimal effort)	334	3	0.191346	0.112337	0.160645	0.0873379	0.219599	0.123229

Speaker Breakdown

speaker_id	n_samples	n_speakers	avg_wer	avg_cer	median_wer	median_cer	corpus_wer_normalized	corpus_cer_normalized
UG052	112	1	0.280096	0.17728	0.238095	0.15154	0.290647	0.182357
UG057	96	1	0.268284	0.184203	0.231682	0.160564	0.285714	0.198264
UG042	92	1	0.248023	0.168603	0.2	0.119225	0.222139	0.150233
UG022	99	1	0.244792	0.123668	0.225806	0.115854	0.258865	0.128099
UG001	102	1	0.232372	0.14961	0.202564	0.112484	0.23612	0.150387
UG036	151	1	0.202456	0.120174	0.166667	0.0952381	0.196267	0.114782
UG058	151	1	0.186769	0.125978	0.153846	0.109091	0.192214	0.126905
UG021	77	1	0.153311	0.0841246	0.148148	0.0714286	0.154983	0.0877571
UG014	133	1	0.120099	0.0753178	0.0909091	0.0434783	0.122183	0.0734395