CoolFace
Modelpublic

aitytech/Whisper-Medium-MLX-FP16

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
0likes20downloads
Model Card

Whisper Medium - MLX FP16

This is the OpenAI Whisper Medium model converted to MLX format with FP16 precision, optimized for Apple Silicon inference.

Model Details

PropertyValue
Base Modelopenai/whisper-medium
Parameters~769M
FormatMLX SafeTensors (FP16)
Model Size1,454.10 MB
Sample Rate16,000 Hz
Audio Layers24
Text Layers24
Hidden Size1024
Attention Heads16
Vocabulary Size51,865

Intended Use

This model is optimized for on-device automatic speech recognition (ASR) on Apple Silicon devices (Mac, iPhone, iPad). It is designed for use with the WhisperKit or MLX frameworks.

Files

  • config.json - Model configuration
  • model.safetensors - Model weights in SafeTensors format (FP16)
  • multilingual.tiktoken - Tokenizer

Usage

python
import mlx_whisper

result = mlx_whisper.transcribe(
    "audio.mp3",
    path_or_hf_repo="aitytech/Whisper-Medium-MLX-FP16",
)
print(result["text"])

Original Model