CoolFace
Modelpublic

YazanSalameh/Whisper-base-Arabic

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face
4likes31downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

Whisper base arabic

It achieves the following results on the evaluation set:

  • —Loss: 0.44
  • —Wer: 34.7

Training and evaluation data

Train set:

  • —mozilla-foundation/commonvoice16_0 ar [train+validation]
  • —BelalElhossany/mgb2audiostranscriptionsnonoverlap
  • —nadsoft/Jordan-Audio

cross validation set: 600 samples in total from the 3 sets to save time during training as colab free tier was used to train the model. note: evaluate accuracy in the way you see fit.

Training procedure

removed arabic (حركات) from the texts. trained the model on the combined dataset for 6 epochs, the best one being the fifth so the model is basically the 5th epoch.

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 32
  • —evalbatchsize: 16
  • —seed: 42
  • —gradientaccumulationsteps: 1
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 500

Training results

Training LossEpochStepValidation LossWer
0.4603114370.493145.8857
0.2867228740.449336.9973
0.2494343110.421943.5553
0.1435457480.440840.2351
0.1345571850.440734.7081