CoolFace
Modelpublic

cs2764/fish-audio-s2-pro-8bit-mlx

sourceHugging Faceotherupdated 6mo agoView on Hugging Face
1likes51downloads
Model Card

fish-audio-s2-pro-8bit

This model is an 8-bit quantized version of `fishaudio/s2-pro`, quantized using mlx.nn.quantize() (groupsize=64, bits=8) via [scripts/quantizefishs2.py](https://github.com/cs2764/mlx-audio-api/blob/main/scripts/quantizefish_s2.py).

Refer to the original model card for more details on the model.

Model Overview

Fish Audio S2 Pro is a leading text-to-speech model with fine-grained inline control of prosody and emotion. Trained on 10M+ hours of audio data across 80+ languages, it combines reinforcement learning alignment with a Dual-Autoregressive architecture.

Architecture

AttributeValue
Total Parameters5B
Slow AR4B (time-axis, primary semantic codebook)
Fast AR400M (residual codebooks per time step)
Audio Codec10 codebooks @ ~21 Hz frame rate
Tensor TypeBF16

Fine-Grained Inline Control

Localized control over speech generation using [tag] syntax with free-form textual descriptions (15,000+ supported tags):

[whisper in small voice]
[professional broadcast tone]
[pitch up]

Common Tags (15,000+ supported): [pause] [emphasis] [laughing] [inhale] [chuckle] [tsk] [singing] [excited] [volume up] [echo] [angry] [whisper] [screaming] [sad] [shocked] and many more.

Supported Languages

Tier 1 (Full Support): Japanese, English, Chinese Tier 2 (Strong Support): Korean, Spanish, Portuguese, Arabic, Russian, French, German Additional: 70+ more languages

Use with mlx-audio

bash
pip install -U mlx-audio

CLI Example:

bash
python -m mlx_audio.tts.generate --model mlx-community/fish-audio-s2-pro-bf16 --text "Hello, this is a test."

Python Example:

python
from mlx_audio.tts.utils import load_model
from mlx_audio.tts.generate import generate_audio

model = load_model("mlx-community/fish-audio-s2-pro-bf16")
generate_audio(
    model=model,
    text="Hello, this is a test.",
    ref_audio="path_to_audio.wav",
    file_prefix="test_audio",
)

Citation

bibtex
@misc{liao2026fishaudios2technical,
      title={Fish Audio S2 Technical Report},
      author={Shijia Liao and Yuxuan Wang and Songting Liu and Yifan Cheng and Ruoyi Zhang and Tianyu Li and Shidong Li and Yisheng Zheng and Xingwei Liu and Qingzheng Wang and Zhizhuo Zhou and Jiahua Liu and Xin Chen and Dawei Han},
      year={2026},
      eprint={2603.08823},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2603.08823},
}

License

This model is released under the Fish Audio Research License:

  • Research use: Free
  • Non-commercial use: Free
  • Commercial use: Requires separate license from Fish Audio (contact: business@fish.audio)

See the original model for full license details.