CoolFace
Modelpublic

abduaziz/whisper-small-uzbek

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
2likes29downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

Whisper Small Uzbek

This model is a fine-tuned version of openai/whisper-small on the Common Voice 17.0 dataset. It achieves the following results on the evaluation set:

  • Loss: 0.3776
  • Wer: 35.8660

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • trainbatchsize: 16
  • evalbatchsize: 16
  • seed: 42
  • optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • lrschedulertype: linear
  • lrschedulerwarmup_steps: 1500
  • training_steps: 5500
  • mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWer
0.9130.25000.821362.5843
0.64040.410000.608251.8716
0.57340.615000.545848.0513
0.50510.820000.484643.8649
0.44071.025000.448341.3901
0.34361.230000.432141.0277
0.30921.435000.418440.1141
0.28611.640000.409139.9753
0.2891.845000.381136.7950
0.28162.050000.373036.7102
0.15472.255000.377635.8660

Framework versions

  • Transformers 4.47.0
  • Pytorch 2.1.1+cu121
  • Datasets 3.2.0
  • Tokenizers 0.21.0