CoolFace
Modelpublic

kiarashQ/fa-ir-stt-whisper-small-v1

sourceHugging Faceapache-2.0updated 10mo agoView on Hugging Face
0likes7downloads
Model Card

whisper-small-fa

This model is a fine-tuned version of openai/whisper-small on an unknown dataset. This was an experiment; better results are likely with more data and longer training. It achieves the following results on the evaluation set:

  • —Loss: 0.1537
  • —Wer: 19.2460

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 16
  • —evalbatchsize: 8
  • —seed: 42
  • —optimizer: Use OptimizerNames.ADAMWTORCHFUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 500
  • —training_steps: 4000

Training results

Training LossEpochStepValidation LossWer
0.22160.193510000.220928.1653
0.19470.387120000.180824.9731
0.14650.580630000.162120.7613
0.1290.774140000.153719.2460

Note: Early stopping at 4k steps due to rising gap (train vs val) indicating overfitting.

How to use

python
from transformers import pipeline

asr = pipeline(
    task="automatic-speech-recognition",
    model="kiarashQ/fa-ir-stt-whisper-small-v1",
    chunk_length_s=30,
    stride_length_s=(5, 5),
    return_timestamps=False
)
out = asr("example.wav")
print(out["text"])

Framework versions

  • —Transformers 4.56.2
  • —Pytorch 2.8.0+cu128
  • —Datasets 4.1.1
  • —Tokenizers 0.22.1