aufklarer/WavLM-Base-Plus-MLX-fp16

WavLM Base Plus MLX fp16

MLX-compatible safetensors export of microsoft/wavlm-base-plus. This bundle is used by speech-swift as the SSL feature-extractor companion for Indic-Mio raw-reference voice cloning.

WavLM runs on 16 kHz mono speech audio and produces hidden states that downstream speech models can use for speaker, content, and paralinguistic representations. For Indic-Mio, speech-swift averages hidden layers 1 and 2, then feeds those features into MioCodec's global encoder to produce the 128-dimensional speaker embedding used by the decoder.

Part of soniqo.audio, an on-device speech toolkit.

Model

Files

Performance

Usage

Swift

import IndicMioTTS

let model = try await IndicMioTTSModel.fromPretrained()
let audio = try await model.generate(
    text: "नमस्ते, यह संदर्भ आवाज़ का परीक्षण है। <happy>",
    language: "hindi",
    referenceAudio: referenceSamples,
    referenceSampleRate: referenceSampleRate
)

The runtime downloads this companion automatically when raw reference audio is used. For local testing with a pre-downloaded bundle:

export INDIC_MIO_WAVLM_BUNDLE=/path/to/WavLM-Base-Plus-MLX-fp16

CLI

speech speak \
  --engine indic-mio \
  --voice-sample reference.wav \
  --output clone.wav \
  "नमस्ते, यह संदर्भ आवाज़ का परीक्षण है। <happy>"

Source

Converted from microsoft/wavlm-base-plus. The upstream WavLM source project is available from microsoft/unilm.

Links

• —speech-swift — Apple SDK
• —Speech Studio — local speech generation and voice cloning app
• —Docs — install and CLI docs
• —soniqo.audio — website
• —blog — blog

License

MIT, following the upstream WavLM source project license.