CoolFace
Modelpublic

IoanaLivia/real_data_1_h_synth_standard_B_horoscope-whisper-small

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes10downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

IoanaLivia/realdata1hsynthstandardB_horoscope-whisper-small

This model is a fine-tuned version of openai/whisper-small on the IoanaLivia/realdata1hsynthstandardB_horoscope dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.2705
  • —Wer: 18.4459

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 8
  • —evalbatchsize: 4
  • —seed: 42
  • —gradientaccumulationsteps: 2
  • —totaltrainbatch_size: 16
  • —optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —num_epochs: 15
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossWer
No log000.417030.1014
0.33321.0420.284119.8556
0.13562.0840.270518.4459
0.06783.01260.281418.9789
0.03314.01680.303720.0791
0.01625.02100.324919.4774
0.00986.02520.342419.2711
0.00657.02940.345818.8413
0.0058.03360.352419.0992
0.00399.03780.360519.0992
0.003410.04200.365418.8929
0.00311.04620.368018.9445
0.002812.05040.370818.8929
0.002613.05460.372919.0132
0.002514.05880.373719.0304
0.002514.65066150.373819.0132

Framework versions

  • —Transformers 4.51.3
  • —Pytorch 2.6.0+cu124
  • —Datasets 3.6.0
  • —Tokenizers 0.21.1