CoolFace
Modelpublic

ElizabethMwangi/whisper-large-v3-swahili-nss-afrivoice-edu

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
2likes14downloads
Model Card

Whisper Large V3 — Swahili NSS (AfriVoice Education Domain)

Stage 2 nonstandard speech fine-tune of openai/whisper-large-v3 on the CDLI Kenyan Swahili Nonstandard Speech dataset. Built on top of ElizabethMwangi/whisper-large-v3-swahili-afrivoice, a Stage 1 checkpoint trained on AfriVoice education-domain speech.

Training Details

  • —Stage 1 base: ElizabethMwangi/whisper-large-v3-swahili-afrivoice (AfriVoice education domain)
  • —Stage 2 dataset: cdli/kenyanswahilinonstandardspeechv1.0 (849 examples)
  • —Language token: sw
  • —Full model training: encoder, decoder, and projection updated
  • —SpecAugment: On
  • —Learning rate: 5e-5 (polynomial decay, warmup 40 steps)
  • —Max steps: 1000
  • —Best checkpoint: step 750
  • —Output dir: swnsstunewhisperv3largeafrivoice_v1.1

Results on Kenyan Swahili Nonstandard Speech (test set, best checkpoint)

Overall, compared to unadapted baseline

ModelOverall WERAvg WER
openai/whisper-large-v3 (no adaptation)0.845-
This model (adapted)0.3070.272
MetricValue
Overall WER0.307
Overall CER0.146
Avg WER0.272
Avg CER0.122
Meaning preservation78.9%

By severity

SeverityWERCER
Mild0.200.08
Moderate0.240.11
Severe0.340.16