CoolFace
Modelpublic

dianavdavidson/wav2vec2-large-xlsr-53-indic_voices-61921-hinglish_mixed_scripts-30_70-1e-4-steps-12000-FT

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face
0likes8downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

wav2vec2-large-xlsr-53-indicvoices-61921-hinglishmixedscripts-3070-1e-4-steps-12000-FT

This model is a fine-tuned version of facebook/wav2vec2-large-xlsr-53 on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 1.0091
  • —Global Wer: 61.6218

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 1
  • —evalbatchsize: 1
  • —seed: 42
  • —gradientaccumulationsteps: 2
  • —totaltrainbatch_size: 2
  • —optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: constantwithwarmup
  • —lrschedulerwarmup_steps: 500
  • —training_steps: 12000
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossGlobal Wer
7.59330.08686003.7613100.0
7.04640.173712003.467499.5355
5.60910.260518002.592997.6544
4.45560.347324001.908589.0578
3.67630.434230001.574881.3959
3.46990.521036001.466678.8152
3.13530.607942001.336774.4910
3.11490.694748001.267470.8321
3.01930.781554001.223770.9468
3.04880.868460001.190567.1102
3.01820.955266001.154067.1618
2.40251.042072001.099965.1029
2.55691.128878001.083163.4972
2.63611.215684001.057063.1932
2.57281.302590001.070062.5222
2.51261.389396001.015061.4555
2.55141.4762102001.026461.5071
2.38591.5630108001.033162.2011
2.58231.6498114000.997760.5551
2.40061.7367120001.009161.6218

Framework versions

  • —Transformers 5.13.0
  • —Pytorch 2.6.0+cu124
  • —Datasets 3.6.0
  • —Tokenizers 0.22.2