CoolFace
Modelpublic

ngoctham/IndexTTS-2.5

sourceHugging Faceotherupdated 1mo agoView on Hugging Face
0likes6downloads
Model Card

IndexTTS-2.5

IndexTTS-2.5 is a zero-shot text-to-speech model that performs voice cloning from a single reference audio. It supports Chinese, English, Japanese, Spanish, and Arabic, with cross-lingual voice transfer and disentangled emotion control.

Compared to IndexTTS-2, it adds Japanese/Spanish/Arabic support, improves inference speed, and enhances controllability of Chinese Pinyin, English CMU phonemes, and Japanese Kana.

Model Details

  • —Developed by: IndexTeam, Bilibili
  • —Model type: Autoregressive zero-shot TTS (GPT + DiT + BigVGAN)
  • —Languages: Chinese, English, Japanese, Spanish, Arabic
  • —License: Bilibili Model License

Model Sources

How to Get Started

Installation

bash
git clone https://github.com/index-tts/index-tts.git && cd index-tts
git lfs pull
pip install -U uv
uv sync --all-extras

Download Model Weights

bash
# HuggingFace
uv tool install "huggingface-hub[cli,hf_xet]"
hf download IndexTeam/IndexTTS-2.5 --local-dir=checkpoints

# ModelScope
uv tool install "modelscope"
modelscope download --model IndexTeam/IndexTTS-2.5 --local_dir checkpoints

Quick Inference

python
from indextts.infer_v2_5 import IndexTTS2

tts = IndexTTS2(cfg_path="checkpoints/config.yaml", model_dir="checkpoints", use_bf16=True)

# Basic voice cloning
tts.infer(
    spk_audio_prompt="prompt.wav",
    text="Hello, this is a voice cloning demo.",
    lang="EN",
    output_path="output.wav",
)

# With emotion control
tts.infer(
    spk_audio_prompt="prompt.wav",
    text="快躲起来!是他要来了!",
    lang="ZH",
    output_path="output.wav",
    emo_vector=[0, 0, 0.8, 0, 0, 0, 0, 0],
)

# With Pinyin/phoneme annotation
tts.infer(
    spk_audio_prompt="prompt.wav",
    text="他在银<行|XING2>里<行|HANG2>走了半天。",
    lang="ZH",
    output_path="output.wav",
)

Web Demo

bash
uv run webui.py --version 2.5 --model_dir ./checkpoints

Uses

Direct Use

  • —Zero-shot voice cloning from a single reference audio
  • —Multilingual speech synthesis (Chinese, English, Japanese, Spanish, Arabic)
  • —Cross-lingual voice transfer (e.g., Chinese speaker voice → English output)
  • —Emotion-controllable speech synthesis via emotion vectors, emotion reference audio, or text-based emotion detection

Downstream Use

  • —Audiobook and podcast production
  • —Voice dubbing and localization
  • —Conversational AI and virtual assistants

Out-of-Scope Use

  • —Impersonation or deception without consent
  • —Generating misleading or fraudulent audio content
  • —Any use that violates applicable laws or regulations

Bias, Risks, and Limitations

  • —Voice cloning quality may vary across speakers and languages.
  • —The model may produce artifacts or unnatural prosody for very long or highly complex text.
  • —Cross-lingual transfer quality depends on the target language and speaker characteristics.
  • —The model does not verify speaker identity or consent. Users are responsible for ethical use.

Evaluation

Zero-Shot TTS (CV3-Eval)

ModelParamszh WER↓zh SS↑en WER↓en SS↑es WER↓es SS↑ja WER↓ja SS↑ar WER↓ar SS↑
VoxCPM22B3.8874.995.1371.575.4974.676.6972.9014.9465.99
CosyVoice3-0.5B0.5B3.8480.014.8874.164.0478.85-76.36--
Fish Audio S2 Pro4B3.6267.793.8361.662.9367.445.1566.1514.1559.43
Qwen3-TTS1.7B3.2773.025.0667.172.8773.175.8970.18--
IndexTTS2.50.8B4.3677.105.1268.063.7576.395.6674.6214.8869.74
IndexTTS2.5-RL0.8B3.9377.923.8967.793.3376.685.3075.4113.5870.36

Cross-Lingual TTS (Chinese prompt → target language)

ModelParamszh→en WER↓zh→en SS↑zh→es WER↓zh→es SS↑zh→ja WER↓zh→ja SS↑zh→ar WER↓zh→ar SS↑
VoxCPM22B4.4864.2516.3864.8911.8471.5411.0967.62
CosyVoice3-0.5B0.5B3.2362.794.5864.04----
IndexTTS2.50.8B3.6263.835.1765.486.5774.169.5171.02
IndexTTS2.5-RL0.8B3.5567.474.8664.476.3875.829.8973.05