Modelpublic

savrabhrao/KalemaTech-Arabic-STT-ASR-based-on-Whisper_safetensors

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face

0likes4downloads

Model Card

Kalemat-Tech Arabic Speech Recognition Model (STT)

نموذج كلماتك للتعرف على الأصوات العربية الفصحى وتحويلها إلى نصوص

KalemaTech-Arabic-STT-ASR-based-on-Whisper-Small (SafeTensors)

⚡ This is a SafeTensors conversion of the original model.

Model Description

This model is a fine-tuned version of Whisper Small trained on Common Voice Arabic 12.0 (augmented dataset).

Performance

—Loss: 0.5362
—WER: 58.5848

What Changed in This Conversion?

Aspect	Original	This Version
Weight Format	PyTorch `.bin`	SafeTensors `.safetensors`
Model Architecture	Unchanged	Unchanged
Weights / Performance	Baseline	Identical (lossless)
Loading Speed	Standard	Faster
Security	Standard	Improved

Why SafeTensors?

—Safer: Prevents arbitrary code execution
—Faster: Memory-mapped loading
—Efficient: Lower memory usage

Usage Example

python

from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq

processor = AutoProcessor.from_pretrained("YOUR_USERNAME/KalemaTech-Arabic-STT-ASR-based-on-Whisper-Small-SafeTensors")
model = AutoModelForSpeechSeq2Seq.from_pretrained("YOUR_USERNAME/KalemaTech-Arabic-STT-ASR-based-on-Whisper-Small-SafeTensors")

Intended Use

Automatic Speech Recognition for Arabic (Modern Standard Arabic)

Limitations

—High WER (~58%)
—May struggle with dialects and noisy audio

Training Data

—Common Voice Arabic 12.0

Augmentations

—25% TimeMasking
—25% SpecAugmentation
—25% Gaussian Noise

Training Hyperparameters

—Learning rate: 1e-05
—Train batch size: 64
—Eval batch size: 8
—Epochs: 25
—Optimizer: Adam
—Scheduler: Linear
—Warmup steps: 500
—Mixed precision: AMP

Training Results

Epoch	Training Loss	Validation Loss	WER
1	0.2728	0.3063	60.47
2	0.1442	0.2878	55.69
3	0.0648	0.3009	59.25
4	0.0318	0.3278	59.29
5	0.0148	0.3539	61.03
6	0.0088	0.3714	56.91
7	0.0061	0.3920	57.55
8	0.0041	0.4149	61.63
9	0.0033	0.4217	58.03
10	0.0033	0.4376	59.95
15	0.0008	0.4856	60.71
20	0.0002	0.5155	58.09
24	0.0001	0.5362	58.58

Framework Versions

—Transformers 4.25.1
—PyTorch 1.13.1+cu117
—Datasets 2.8.0
—Tokenizers 0.13.2

Conversion Details

—Format: SafeTensors
—Type: Lossless conversion
—Weights: Numerically identical

Credits

—Original Model: Mohamed Salama
—Conversion: SafeTensors format for better performance and security