mesolitica/Malaysian-F5-TTS-v2

Full Parameter Finetuning Malaysian Emilia F5-TTS v2

Continue training from SWivid/F5-TTS F5TTS_Base checkpoint on Malaysian-Emilia,

with total 8472 hours included 600 hours Mandarin sampled from amphion/Emilia-Dataset.

Features

1. 1.This model should be able to zero-shot voice conversion any Malaysian and Singaporean speakers.
2. 2.This model able to generate minimal filler sounds such as erm, huh, for example below,

<audio controls src="https://cdn-uploads.huggingface.co/production/uploads/5e73316106936008a9ee6523/qoFxdAgPkxTxsNxrbdjs_.wav"></audio>

Isu sekarangnya, erm, kita harus jadi yang terbaik untuk rakyat Malaysia, dan kita, uh, kena makan nasi lemak yang sedap lagi lazat, hah, penat nak kena cakap.

Checkpoints

We uploaded full checkpoints with optimizer states at checkpoints.

Dataset

We train on postfilter Malaysian-Emilia called Malaysian-Voice-Conversion

Source code

All source code at https://github.com/mesolitica/malaya-speech/tree/master/session/f5-tts