CoolFace
Modelpublic

pritam18/swadeshi_bhojpuriwav2vec2asr

sourceHugging Faceapache-2.0updated 4y agoView on Hugging Face
0likes12downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

swadeshi_bhojpuriwav2vec2asr

This model is a fine-tuned version of theainerd/Wav2Vec2-large-xlsr-hindi on the None dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.2155
  • —Wer: 0.2931

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 8
  • —evalbatchsize: 8
  • —seed: 42
  • —gradientaccumulationsteps: 2
  • —totaltrainbatch_size: 16
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 500
  • —num_epochs: 30
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWer
3.69283.24002.48200.9925
1.69816.48000.80530.6320
0.9759.612000.54200.4980
0.767212.816000.42240.4233
0.63616.020000.34810.3774
0.556219.224000.28610.3409
0.497322.428000.24500.3211
0.461625.632000.22300.3004
0.426428.836000.21550.2931

Framework versions

  • —Transformers 4.20.0.dev0
  • —Pytorch 1.11.0+cu113
  • —Datasets 2.2.3.dev0
  • —Tokenizers 0.12.1