CoolFace
Modelpublic

LocalAI-io/whisper-small-it

sourceHugging Facemitupdated 4mo agoView on Hugging Face
0likes7downloads
Model Card

whisper-small-it

Fine-tuned openai/whisper-small (244M params) for Italian ASR.

Author: Ettore Di Giacinto

Brought to you by the LocalAI team. This model can be used directly with LocalAI.

Usage with LocalAI

This model is ready to use with LocalAI via the whisperx backend.

Save the following as whisperx-small-it.yaml in your LocalAI models directory:

yaml
name: whisperx-small-it
backend: whisperx
known_usecases:
  - transcript
parameters:
  model: LocalAI-io/whisper-small-it-ct2-int8
  language: it

Then transcribe audio via the OpenAI-compatible endpoint:

bash
curl http://localhost:8080/v1/audio/transcriptions \
  -H "Content-Type: multipart/form-data" \
  -F file="@audio.mp3" \
  -F model="whisperx-small-it"

Results

Evaluated on Common Voice 25.0 Italian test set (15,184 samples):

StepWER
100018.36%
300015.45%
500014.58%
700013.61%
1000013.0%

Training Details

  • —Base model: openai/whisper-small (244M parameters)
  • —Dataset: Common Voice 25.0 Italian (173k train, 15k dev, 15k test)
  • —Steps: 10,000
  • —Precision: bf16 on NVIDIA GB10

Usage

Transformers

python
from transformers import pipeline

pipe = pipeline("automatic-speech-recognition", model="LocalAI-io/whisper-small-it")
result = pipe("audio.mp3", generate_kwargs={"language": "it", "task": "transcribe"})
print(result["text"])

CTranslate2 / faster-whisper

For optimized CPU inference: LocalAI-io/whisper-small-it-ct2-int8

Links