CoolFace
Modelpublic

thantzinphyo/Whisper-Tiny-Myanmar-Full-Fine-Tune

sourceHugging Faceapache-2.0updated 25d agoView on Hugging Face
0likes109downloads
Model Card

Whisper Tiny Myanmar (Direct End-to-End Fine-Tuned)

This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) trained directly on the [thantzinphyo/burmese-speech-refined-openslr-80](https://huggingface.co/datasets/thantzinphyo/burmese-speech-refined-openslr-80) dataset.

Benchmark Results (Best Checkpoint — Step 1200)

  • —Best Validation WER: 51.7196%
  • —Best Validation CER: 13.1144% (Character Accuracy: ~86.89%)
  • —Training Loss: 0.000098 | Validation Loss: 0.2324 ---

How to Use (Python Inference)

python
import torch
from transformers import pipeline

pipe = pipeline(
    "automatic-speech-recognition",
    model="thantzinphyo/Whisper-Tiny-Myanmar-Full-Fine-Tune",
    device=0 if torch.cuda.is_available() else -1
)

result = pipe("your_burmese_audio.wav", generate_kwargs={"language": "my", "task": "transcribe"})
print("Transcribed Text:", result["text"]) # အခု ကတော့ သဘောတရားလေး ပဲ ပြောပြတာပါ

Full 1500 Steps Training History

StepTraining LossValidation LossWER (%)CER (%)Status
1006.2548510.75700498.809574.7487Early Warmup
2001.6959340.20270078.130528.0049Rapid Convergence
3000.2730450.17473164.021219.3644
4000.1240230.18786361.772518.9008
5000.0710830.19790860.141116.4377
6000.0428260.20307356.746015.1810
7000.0280460.21557658.068815.5161
8000.0160050.21890457.539721.2020
9000.0087200.21991754.629614.2035
10000.0021900.23337653.791913.8405
11000.0004450.23196352.954113.4663
12000.0000980.23241751.719613.1144Best Checkpoint
13000.0000840.23355351.895913.1535
14000.0000790.23396551.984113.0529
15000.0000790.23402251.895913.0418

Hyperparameters

  • —Base Model: openai/whisper-tiny (100% End-to-End)
  • —Effective Batch Size: 64 (16 per device × 4 gradient accumulation)
  • —Learning Rate: 1.5e-4 with Cosine Annealing Scheduler
  • —Warmup Steps: 150
  • —Total Steps: 1500