CoolFace
Modelpublic

Kanompung/whisper-th-lotusdis-lora

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
1likes
Model Card

๐Ÿ‡น๐Ÿ‡ญ Whisper Thai - LOTUSDIS Fine-tuned (LoRA)

Fine-tuned nectec/Pathumma-whisper-th-large-v3 for Thai distant meeting transcription.

Training Details

  • โ€”Task: LOTUSDIS Distant Meeting Transcription Challenge
  • โ€”Method: LoRA (rank=64, alpha=128)
  • โ€”Training data: Multi-microphone (6 mic types) โ‰ˆ 95K samples
  • โ€”Epochs: 1
  • โ€”Effective batch size: 48
  • โ€”Precision: BF16
  • โ€”Trainable params: ~2.4% of total

Usage

python
from transformers import pipeline

asr = pipeline(
    "automatic-speech-recognition",
    model="Kanompung/whisper-th-lotusdis-lora",
    device="cuda",
    chunk_length_s=30,
)

result = asr("audio.mp3", generate_kwargs={"language": "thai", "task": "transcribe"})
print(result["text"])

LoRA Adapter Only

If you want just the adapter (~150 MB):

python
from peft import PeftModel
from transformers import WhisperForConditionalGeneration

base = WhisperForConditionalGeneration.from_pretrained("nectec/Pathumma-whisper-th-large-v3")
model = PeftModel.from_pretrained(base, "Kanompung/whisper-th-lotusdis-lora-adapter")