CoolFace
Modelpublic

Leonel-Maia/whisper-bible

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes7downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

whisper-bible

This model is a fine-tuned version of abiyo27/whisper-small-ewe-2 on the Leonel-Maia/ewe_dataset dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.4076
  • —Wer: 0.3640

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 1
  • —evalbatchsize: 2
  • —seed: 42
  • —gradientaccumulationsteps: 8
  • —totaltrainbatch_size: 8
  • —optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 500
  • —num_epochs: 60.0
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWer
0.53660.43985000.52600.4396
0.43240.879610000.45240.3907
0.39111.319315000.42610.3697
0.38891.759120000.41110.3650
0.30052.198825000.41570.3608
0.30212.638630000.40760.3640
0.21663.078335000.41380.3609
0.21233.518140000.42010.3602
0.25963.957945000.41820.3598
0.17034.397650000.44480.3698
0.1794.837455000.44210.3798

Framework versions

  • —Transformers 4.50.3
  • —Pytorch 2.7.0+cu126
  • —Datasets 3.5.0
  • —Tokenizers 0.21.1