CoolFace
Modelpublic

Khurram123/whisper-medium-urdu-fleurs

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes9downloads
Model Card

๐ŸŽ™๏ธ Whisper Medium Urdu: LoRA Fine-Tuned

This model is a high-performance Automatic Speech Recognition (ASR) system for Urdu (Pakistan). It utilizes LoRA (Low-Rank Adaptation) to fine-tune the openai/whisper-medium backbone, achieving significant accuracy improvements on regional accents and vocabulary while remaining computationally efficient.

โš™๏ธ Technical Specifications

  • โ€”Base Architecture: Transformer Encoder-Decoder (Whisper)
  • โ€”Adaptation Method: PEFT/LoRA ($r=32$, $\alpha=64$)
  • โ€”Precision: float16
  • โ€”Inference Speed: ~7.7 samples/sec on RTX 4060 Ti

๐Ÿ“Š Training Environment & Results

Developed in a specialized Ubuntu environment designed for Urdu NLP tasks.

ParameterValue
HardwareNVIDIA GeForce RTX 4060 Ti 16 GB
DatasetGoogle FLEURS (ur_pk)
Epochs15
Final Train Loss0.33
Final Eval Loss0.40

๐Ÿš€ Deployment

python
from transformers import pipeline
import torch

pipe = pipeline(
    "automatic-speech-recognition", 
    model="Khurram123/whisper-medium-urdu-fleurs", 
    device=0, 
    torch_dtype=torch.float16
)

# Example: Transcribing Urdu audio
output = pipe("path_to_audio.wav", generate_kwargs={"language": "urdu"})
print(output["text"])