Modelpublic

cstr/raon-opentts-0.3b-GGUF

sourceHugging Facecc-by-nc-4.0updated 24d agoView on Hugging Face

0likes385downloads

Model Card

Raon-OpenTTS 0.3B — GGUF for CrispASR

GGUF conversion of [KRAFTON/Raon-OpenTTS-0.3B](https://huggingface.co/KRAFTON/Raon-OpenTTS-1B) — an English F5-TTS DiT (flow-matching, zero-shot voice cloning) paired with a 16 kHz HiFi-GAN vocoder (speechbrain/tts-hifigan-libritts-16kHz lineage).

License: CC-BY-NC-4.0 — non-commercial use only (upstream model license). Attribution: Raon-OpenTTS by KRAFTON. The slaney mel filterbank + Hann window are computed with torchaudio and shipped inside the GGUF.

Single self-contained GGUF: F5-TTS DiT (dim=1024, 22 layers) + HiFi-GAN vocoder + shipped mel filterbank/window + 5555-char vocab.

Usage (CrispASR)

bash

crispasr --backend raon -m auto \
    --voice reference.wav --ref-text "transcript of the reference" \
    --tts "Text to synthesize." --tts-output out.wav --i-have-rights

-m auto downloads this GGUF (with the CC-BY-NC-4.0 acceptance notice).

Validation: the full CrispASR pipeline (DiT + sbhifigan mel + HiFi-GAN) passes a TTS→ASR roundtrip — synthesized speech transcribes back to the input text at 0.90 word overlap. The vocoder was verified in isolation against the reference (cosine 0.998). Converted with models/convert-raon-opentts-to-gguf.py.

Performance note: the HiFi-GAN vocoder currently runs on CPU (~40 s per short utterance); the DiT is fast on a GPU build. A ggml vocoder path is planned.