CoolFace
Modelpublic

LocalAI-io/whisper-small-it-multi-ct2-int8

sourceHugging Facemitupdated 4mo agoView on Hugging Face
0likes10downloads
Model Card

whisper-small-it-multi-ct2-int8

CTranslate2 INT8 quantized version of LocalAI-io/whisper-small-it-multi for fast CPU inference.

Author: Ettore Di Giacinto

Brought to you by the LocalAI team. This model can be used directly with LocalAI.

Usage with LocalAI

This model is ready to use with LocalAI via the whisperx backend.

Save the following as whisperx-small-it-multi.yaml in your LocalAI models directory:

yaml
name: whisperx-small-it-multi
backend: whisperx
known_usecases:
  - transcript
parameters:
  model: LocalAI-io/whisper-small-it-multi-ct2-int8
  language: it

Then transcribe audio via the OpenAI-compatible endpoint:

bash
curl http://localhost:8080/v1/audio/transcriptions \
  -H "Content-Type: multipart/form-data" \
  -F file="@audio.mp3" \
  -F model="whisperx-small-it-multi"

Usage

faster-whisper

python
from faster_whisper import WhisperModel

model = WhisperModel("LocalAI-io/whisper-small-it-multi-ct2-int8", device="cpu", compute_type="int8")
segments, info = model.transcribe("audio.mp3", language="it")
for segment in segments:
    print(f"[{segment.start:.1f}s - {segment.end:.1f}s] {segment.text}")

Links