CoolFace
Modelpublic

emilios/whisper-sm-farsipal-e5

sourceHugging Faceapache-2.0updated 4y agoView on Hugging Face
0likes12downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

Whisper small Greek Farsioal and El Greco

This model is a fine-tuned version of emilios/whisper-sm-el-farsipal-e4 on the mozilla-foundation/commonvoice110,google/fleurs el,elgr dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.4871
  • —Wer: 17.1991

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-06
  • —trainbatchsize: 32
  • —evalbatchsize: 16
  • —seed: 42
  • —distributed_type: multi-GPU
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 500
  • —training_steps: 20000

Training results

Training LossEpochStepValidation LossWer
0.12592.4910000.483418.3692
0.10024.4920000.460417.8027
0.10966.9830000.455317.8770
0.08859.4640000.455117.9606
0.067511.9550000.463117.9049
0.067514.4460000.461917.9049
0.064516.9370000.467817.6727
0.053519.4180000.468517.6634
0.03921.4990000.474617.6727
0.044723.98100000.476117.6634
0.039326.46110000.479217.7656
0.030828.95120000.485117.8678
0.030131.44130000.484617.4499
0.03133.93140000.484917.8306
0.026336.41150000.488017.6170
0.025638.9160000.487117.1991
0.023641.39170000.488317.2641
0.019543.88180000.488017.5706
0.019346.36190000.499317.7285
0.016148.85200000.496817.8306

Framework versions

  • —Transformers 4.26.0.dev0
  • —Pytorch 2.0.0.dev20221216+cu116
  • —Datasets 2.7.1.dev0
  • —Tokenizers 0.13.2