CoolFace
Modelpublic

marlhex/whisper-small-dv

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
1likes7downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

Whisper Small - DV - Marlhex

This model is a fine-tuned version of openai/whisper-small on the Common Voice 13 dataset.

Model description

Whisper fine tunned for dv language (Maldivan language, Divehi) from Maldives

Intended uses & limitations

part of the AI portfolio to show to companies some of the work I've done in the Audio pilar.

Training and evaluation data

WER normalized.

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 16
  • —evalbatchsize: 16
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: constantwithwarmup
  • —lrschedulerwarmup_steps: 5
  • —training_steps: 10
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWer OrthoWer
No log0.0326101.9577100.0100.0

Framework versions

  • —Transformers 4.45.1
  • —Pytorch 2.4.0
  • —Datasets 3.0.1
  • —Tokenizers 0.20.0

Next Steps

  • —Looking forward to training more languages that require more GB of storage, but my setup is limited.