CoolFace
Modelpublic

susmitabhatt/whisper-a-nomimo-18

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes5downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

whisper-a-nomimo-18

This model is a fine-tuned version of openai/whisper-small on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0290
  • Wer: 143.6728

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0004
  • trainbatchsize: 8
  • evalbatchsize: 8
  • seed: 42
  • gradientaccumulationsteps: 2
  • totaltrainbatch_size: 16
  • optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • lrschedulertype: linear
  • lrschedulerwarmup_steps: 132
  • num_epochs: 18
  • mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWer
1.06161.01040.217330.0926
0.142.02080.077018.5957
0.07143.03120.072319.6759
0.05134.04160.067120.5247
0.03815.05200.041517.9012
0.04686.06240.046322.3765
0.03527.07280.113942.5154
0.01958.08320.0457148.7654
0.01859.09360.0430172.6852
0.012910.010400.0312154.8611
0.010611.011440.0405145.5247
0.008412.012480.0325154.9383
0.005813.013520.0320152.0062
0.003914.014560.0263144.5216
0.004415.015600.0270148.3796
0.002816.016640.0285148.6883
0.001517.017680.0285147.3765
0.00217.830918540.0290143.6728

Framework versions

  • Transformers 4.48.0.dev0
  • Pytorch 2.4.0
  • Datasets 3.1.0
  • Tokenizers 0.21.0