oliverguhr/wav2vec2-large-xlsr-53-german-cv9
1181
wav2vec2-large-xlsr-53-german-cv9
This model is a fine-tuned version of ./facebook/wav2vec2-large-xlsr-53 on the MOZILLA-FOUNDATION/COMMONVOICE9_0 - DE dataset.
It achieves the following results on the test set:
- CER: 2.273015898213336
- Wer: 9.480663281840769
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- trainbatchsize: 16
- evalbatchsize: 32
- seed: 42
- gradientaccumulationsteps: 8
- totaltrainbatch_size: 128
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lrschedulertype: linear
- lrschedulerwarmup_ratio: 0.1
- num_epochs: 50.0
- mixedprecisiontraining: Native AMP
Training results
Framework versions
- Transformers 4.19.0.dev0
- Pytorch 1.11.0+cu113
- Datasets 2.0.0
- Tokenizers 0.11.6
