CoolFace
Modelpublic

mlx-community/Mega-ASR-bf16

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
1likes52downloads
Model Card

Mega-ASR-bf16

This model was converted to MLX format from `zhifeixie/Mega-ASR` (built on `Qwen/Qwen3-ASR-1.7B`) using mlx-audio.

Mega-ASR is a robustness layer over Qwen3-ASR-1.7B: a tiny audio-quality router classifies each utterance as clean or degraded and switches a dense LoRA adapter in/out of the base weights at inference — degraded audio runs the LoRA (robust) path, clean audio runs the unmodified base path. This recovers large WER gains on noisy/far-field speech while leaving clean-speech accuracy unchanged.

The base weights are stored as dense bf16 on purpose: Mega-ASR adds fp32 LoRA deltas to the base at inference, so the base cannot be quantized without losing the runtime router/LoRA switching.

Use with mlx-audio

bash
pip install mlx-audio
python
from mlx_audio.stt import load

model = load("mlx-community/Mega-ASR-bf16")
result = model.generate("audio.wav", language="en")
print(result.text)

CLI:

bash
python -m mlx_audio.stt.generate --model mlx-community/Mega-ASR-bf16 --audio audio.wav

The router decides per-utterance automatically; no flags needed.

Validation

Reproduces the paper's published robustness gains. Word Error Rate on the real NOIZEUS corpus (8 noise types × 4 SNR × 30 utterances, Apple Silicon):

SNRbase (Qwen3-ASR)Mega-ASR (robust)paper basepaper robust
0 dB23.3520.6123.9719.80
5 dB8.476.51
10 dB3.312.173.412.79
15 dB2.120.83
overall9.317.539.457.52

Overall robust WER 7.53 vs the paper's 7.52 — a ~20% relative reduction over the Qwen3-ASR baseline, reproduced. On clean read speech (FLEURS) the model matches plain Qwen3-ASR, as intended.

License & attribution

Apache-2.0. Built on zhifeixie/Mega-ASR (adapter + router) and Qwen/Qwen3-ASR-1.7B (base).