CoolFace
Modelpublic

Rateddany/wav2vec2-xls-r-300m-kab-30m

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes5downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

wav2vec2-xls-r-300m-kab-30m

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 1.4897
  • —Wer: 0.7494
  • —Cer: 0.2461

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 7e-05
  • —trainbatchsize: 16
  • —evalbatchsize: 8
  • —seed: 42
  • —optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.98) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_ratio: 0.1
  • —training_steps: 5000
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWerCer
3.617416.12905003.09941.01.0
3.058432.258110003.07221.01.0
1.858848.387115001.71830.98510.5910
1.030364.516120001.39110.87390.3154
0.766780.645225001.33970.83080.2813
0.582496.774230001.45420.80560.2703
0.4857112.903235001.46500.80390.2636
0.445129.032340001.50690.77290.2557
0.4163145.161345001.47670.75400.2477
0.3967161.290350001.48970.74940.2461

Framework versions

  • —Transformers 4.50.0
  • —Pytorch 2.6.0+cu124
  • —Datasets 3.5.0
  • —Tokenizers 0.21.1