basha3la2/whisper-base-de-v3

Whisper Base DE v3 - Alaa Albasha

This model is a fine-tuned version of basha3la2/whisper-base-de-v2 on the ASR German Mixed dataset.

It achieves the following results on the evaluation set:

• —Loss: 0.2006
• —Wer: 13.0467

Training History

This is the third round of fine-tuning Whisper Base for German ASR:

Training Note

Training for v3 was planned for 30,000 steps but was interrupted at approximately step 10,000 due to Kaggle's 12-hour session limit. The last checkpoint was saved and pushed to the Hub. Further training continues in v4.

Training Results

Training Hyperparameters

• —learning_rate: 3e-06
• —trainbatchsize: 8
• —evalbatchsize: 8
• —gradientaccumulationsteps: 2 (effective batch size: 16)
• —seed: 42
• —optimizer: AdamW
• —lrschedulertype: linear
• —lrschedulerwarmup_steps: 200
• —training_steps: 30,000 (interrupted at ~10,000)
• —mixedprecisiontraining: FP16

Intended Use

German automatic speech recognition, deployed on Radxa Rock 5B+ via RKNN (NPU inference).

Framework versions

• —Transformers 5.x
• —PyTorch 2.x
• —Datasets 5.x