CoolFace
Modelpublic

scasutt/wav2vec2-base_toy_train_data_fast_10pct

sourceHugging Faceapache-2.0updated 4y agoView on Hugging Face
0likes40downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

wav2vec2-basetoytraindatafast_10pct

This model is a fine-tuned version of facebook/wav2vec2-base on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 1.3087
  • Wer: 0.7175

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • trainbatchsize: 8
  • evalbatchsize: 8
  • seed: 42
  • gradientaccumulationsteps: 2
  • totaltrainbatch_size: 16
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • lrschedulerwarmup_steps: 1000
  • num_epochs: 20

Training results

Training LossEpochStepValidation LossWer
3.13091.052503.45410.9982
3.04992.15003.02310.9982
1.48393.157501.43870.9257
1.16974.210001.37290.8792
0.93535.2512501.26080.8445
0.72986.315001.18670.8052
0.64187.3517501.24140.7997
0.56988.420001.22400.7766
0.50849.4522501.19100.7687
0.491210.525001.22410.7617
0.414411.5527501.24120.7477
0.415312.630001.27360.7511
0.40513.6532501.28270.7328
0.385214.735001.19810.7331
0.382915.7537501.30350.7347
0.353816.8140001.30030.7240
0.338517.8642501.33540.7304
0.310818.9145001.29830.7229
0.303719.9647501.30870.7175

Framework versions

  • Transformers 4.17.0
  • Pytorch 1.11.0+cu102
  • Datasets 2.0.0
  • Tokenizers 0.11.6