CoolFace
Modelpublic

Hanhpt23/whisper-small-frenchmed-free_ED3-11

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes7downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

openai/whisper-small

This model is a fine-tuned version of openai/whisper-small on the pphuc25/FrenchMed dataset. It achieves the following results on the evaluation set:

  • —Loss: 1.2159
  • —Wer: 71.8475
  • —Cer: 60.7403

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 8
  • —evalbatchsize: 8
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 100
  • —num_epochs: 20

Training results

Training LossEpochStepValidation LossWerCer
0.87061.02150.8600178.2258102.3256
0.60252.04300.8573114.149671.0059
0.39623.06450.896888.929667.1529
0.22394.08600.941296.187760.4651
7.04875.010756.4281779.6188546.2915
5.21356.012904.596095.014776.2626
0.25697.015051.0109228.7390163.0246
0.20828.017201.0642215.1026163.8090
0.15119.019351.0990162.3167156.4882
0.024710.021501.1002160.6305182.1660
0.015511.023651.125359.970762.7081
0.00712.025801.1525134.8240131.4298
0.004213.027951.1656164.0762154.8507
0.002414.030101.1838118.9883105.3530
0.002715.032251.187687.536771.3362
0.001516.034401.197857.258144.8190
0.001717.036551.199972.287460.8504
0.001218.038701.211971.847560.7541
0.001119.040851.214471.847560.7403
0.001120.043001.215971.847560.7403

Framework versions

  • —Transformers 4.41.1
  • —Pytorch 2.3.0
  • —Datasets 2.19.1
  • —Tokenizers 0.19.1