CoolFace
Modelpublic

dmatekenya/whisper-large-v3-chichewa-mix-v1-bible12h-trigram6h-concat

sourceHugging Faceapache-2.0updated 7d agoView on Hugging Face
0likes67downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

whisper-large-v3-chichewa-mix-v1-bible12h-trigram6h-concat

This model is a fine-tuned version of openai/whisper-large-v3 on the None dataset. It achieves the following results on the evaluation set:

  • —Loss: 1.3417
  • —Wer: 73.3432
  • —Cer: 34.6401

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 32
  • —evalbatchsize: 8
  • —seed: 42
  • —gradientaccumulationsteps: 2
  • —totaltrainbatch_size: 64
  • —optimizer: Use OptimizerNames.ADAMWTORCHFUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 500
  • —training_steps: 7500

Training results

Training LossEpochStepValidation LossWerCer
1.63452.15525001.536889.649041.0708
1.11864.310310001.274478.773037.2893
0.95806.465515001.237574.671935.8536
0.90118.620720001.244876.870137.6876
0.836610.775925001.264174.212634.2557
0.661112.931030001.279274.114235.3626
0.717715.086235001.305573.244834.7467
0.668117.241440001.321574.819635.3997
0.680019.396645001.329674.311034.6749
0.638521.551750001.337773.343234.3206
0.656423.706955001.341674.901635.4553
0.631425.862160001.341773.343234.6401

Framework versions

  • —Transformers 5.17.0
  • —Pytorch 2.14.0+cu130
  • —Datasets 5.0.1
  • —Tokenizers 0.23.2