CoolFace
Modelpublic

kingabzpro/wav2vec2-60-Urdu-V8

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
1likes29downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

πŸ”΄Check out my latest URDU ASR model with `25 WER` here -> kingabzpro/whisper-large-v3-turbo-urdu


wav2vec2-60-Urdu-V8

This model is a fine-tuned version of Harveenchadha/vakyansh-wav2vec2-urdu-urm-60 on the common_voice dataset. It achieves the following results on the evaluation set:

  • β€”Loss: 11.4832
  • β€”Wer: 0.5729
  • β€”Cer: 0.3170

Training hyperparameters

The following hyperparameters were used during training:

  • β€”learning_rate: 7.5e-05
  • β€”trainbatchsize: 16
  • β€”evalbatchsize: 8
  • β€”seed: 42
  • β€”gradientaccumulationsteps: 2
  • β€”totaltrainbatch_size: 32
  • β€”optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • β€”lrschedulertype: linear
  • β€”lrschedulerwarmup_steps: 200
  • β€”num_epochs: 50
  • β€”mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWerCer
19.6718.331007.76710.87950.4492
2.08516.672009.27590.62010.3320
0.663325.03008.70250.57380.3104
0.38833.3340010.22860.58520.3128
0.282241.6750011.19530.57380.3174
0.229350.060011.48320.57290.3170

Framework versions

  • β€”Transformers 4.16.2
  • β€”Pytorch 1.10.0+cu111
  • β€”Datasets 1.18.3
  • β€”Tokenizers 0.11.0