CoolFace
Modelpublic

mobilint/whisper.cpp

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
0likes
Model Card

whisper.cpp Models for Mobilint NPU

This repository provides all model files needed to run whisper.cpp-mblt, the Mobilint NPU-accelerated fork of whisper.cpp.

Available Files

ModelFileSizeDescription
whisper-smallggml-small.bin466 MBGGML model (tokenizer + weights for CPU fallback)
whisper-smallggml-small-encoder.mxq93 MBMobilint NPU encoder
whisper-smallggml-small-decoder.mxq159 MBMobilint NPU decoder

Usage

NPU Inference (Mobilint)

bash
# Download all files and run
whisper-cli-mblt \
  -m ggml-small.bin \
  --mxq-encoder ggml-small-encoder.mxq \
  --mxq-decoder ggml-small-decoder.mxq \
  -f audio.wav

# Or auto-download from HuggingFace
whisper-cli-mblt -hf mobilint/whisper-small -f audio.wav

CPU Inference (standard whisper.cpp)

The ggml-small.bin file is also compatible with standard whisper.cpp for CPU-only inference:

bash
whisper-cli -m ggml-small.bin -f audio.wav

Model Details

  • Base model: openai/whisper-small (244M parameters)
  • Languages: 99 languages supported (English, Chinese, German, Spanish, Russian, Korean, French, Japanese, Portuguese, Turkish, Polish, and more)
  • Tasks: Transcription and translation (to English)
  • NPU pipeline: Audio → mel spectrogram (CPU) → encoder (NPU, global4) → decoder (NPU, single core, greedy) → text

Related Repositories

  • [mobilint/whisper-small](https://huggingface.co/mobilint/whisper-small) — Original Mobilint whisper-small model with config.json and tokenizer files
  • [ggerganov/whisper.cpp](https://huggingface.co/ggerganov/whisper.cpp) — Upstream GGML models for CPU inference

License

Apache 2.0 (same as the original OpenAI Whisper model)