CoolFace
Modelpublic

lgris/wav2vec2_base_10k_8khz_pt_cv7_2

sourceHugging Faceapache-2.0updated 5y agoView on Hugging Face
2likes55downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

wav2vec2base10k8khzptcv72

This model is a fine-tuned version of lgris/seasr_2022_base_10k_8khz_pt on the common_voice dataset. It achieves the following results on the evaluation set:

  • Loss: 76.3426
  • Wer: 0.1979

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-05
  • trainbatchsize: 8
  • evalbatchsize: 8
  • seed: 42
  • gradientaccumulationsteps: 2
  • totaltrainbatch_size: 16
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • lrschedulerwarmup_steps: 100
  • training_steps: 10000

Training results

Training LossEpochStepValidation LossWer
189.13620.6550080.63470.2139
174.25871.3100080.20620.2116
164.6761.95150078.21610.2073
176.58562.6200078.89200.2074
164.35833.25250077.28650.2066
161.4143.9300077.88880.2048
158.2834.55350077.34720.2033
159.22655.19400079.09530.2036
156.39675.84450076.68550.2029
154.27436.49500077.77850.2015
156.64977.14550077.12200.2033
157.30387.79600076.29260.2027
162.81518.44650076.76020.2013
151.86139.09700077.47770.2011
153.02259.74750076.52060.2001
157.5210.39800076.10610.2006
145.059211.04850076.78550.1992
150.006611.69900076.00580.1988
146.812812.34950076.28530.1987
146.914812.991000076.34260.1979

Framework versions

  • Transformers 4.16.2
  • Pytorch 1.10.0+cu111
  • Datasets 1.18.3
  • Tokenizers 0.11.0