YazanSalameh/Whisper-base-Arabic
431
<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->
Whisper base arabic
It achieves the following results on the evaluation set:
- Loss: 0.44
- Wer: 34.7
Training and evaluation data
Train set:
- mozilla-foundation/commonvoice16_0 ar [train+validation]
- BelalElhossany/mgb2audiostranscriptionsnonoverlap
- nadsoft/Jordan-Audio
cross validation set: 600 samples in total from the 3 sets to save time during training as colab free tier was used to train the model. note: evaluate accuracy in the way you see fit.
Training procedure
removed arabic (حركات) from the texts. trained the model on the combined dataset for 6 epochs, the best one being the fifth so the model is basically the 5th epoch.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- trainbatchsize: 32
- evalbatchsize: 16
- seed: 42
- gradientaccumulationsteps: 1
- lrschedulertype: linear
- lrschedulerwarmup_steps: 500
