Khurram123/whisper-medium-urdu-fleurs
09
๐๏ธ Whisper Medium Urdu: LoRA Fine-Tuned
This model is a high-performance Automatic Speech Recognition (ASR) system for Urdu (Pakistan). It utilizes LoRA (Low-Rank Adaptation) to fine-tune the openai/whisper-medium backbone, achieving significant accuracy improvements on regional accents and vocabulary while remaining computationally efficient.
โ๏ธ Technical Specifications
- Base Architecture: Transformer Encoder-Decoder (Whisper)
- Adaptation Method: PEFT/LoRA ($r=32$, $\alpha=64$)
- Precision:
float16 - Inference Speed: ~7.7 samples/sec on RTX 4060 Ti
๐ Training Environment & Results
Developed in a specialized Ubuntu environment designed for Urdu NLP tasks.
๐ Deployment
from transformers import pipeline
import torch
pipe = pipeline(
"automatic-speech-recognition",
model="Khurram123/whisper-medium-urdu-fleurs",
device=0,
torch_dtype=torch.float16
)
# Example: Transcribing Urdu audio
output = pipe("path_to_audio.wav", generate_kwargs={"language": "urdu"})
print(output["text"])