CoolFace
Modelpublic

dianavdavidson/wav2vec2-large-xlsr-53-mucs-61966-hinglish_mixed_scripts-alldata-1e-4-steps-12000-FT

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face
0likes7downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

wav2vec2-large-xlsr-53-mucs-61966-hinglishmixedscripts-alldata-1e-4-steps-12000-FT

This model is a fine-tuned version of facebook/wav2vec2-large-xlsr-53 on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 1.1267
  • —Global Wer: 37.9799

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 4
  • —evalbatchsize: 4
  • —seed: 42
  • —gradientaccumulationsteps: 2
  • —totaltrainbatch_size: 8
  • —optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: constantwithwarmup
  • —lrschedulerwarmup_steps: 500
  • —training_steps: 12000
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossGlobal Wer
6.48690.159410002.614588.1350
2.44600.318820001.375653.7971
2.15010.478230001.284549.0613
1.90810.637640001.296241.5967
1.93670.796950001.209540.6749
1.72790.956360001.165939.1047
1.62621.115770001.182238.3464
1.66131.275180001.192239.3330
1.68701.434590001.152538.2393
1.50871.5939100001.175138.1970
1.50681.7533110001.137837.9968
1.50651.9127120001.126737.9799

Framework versions

  • —Transformers 5.13.0
  • —Pytorch 2.6.0+cu124
  • —Datasets 3.6.0
  • —Tokenizers 0.22.2