CoolFace
Modelpublic

edwixx/omnivoice-brpt-v15

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
2likes164downloads
Model Card

OmniVoice BR-PT v1.5

OmniVoice BR-PT v1.5 is the selected Brazilian Portuguese fine-tune of `k2-fsa/OmniVoice`. This release uses the v1.5 gold-subset refinement checkpoint selected from checkpoint-9000.

It is optimized for Brazilian Portuguese TTS experiments, voice-design, and voice-cloning workflows using OmniVoice.

Why This Checkpoint

We evaluated base OmniVoice, the first BR-PT run, and v1.5 refine checkpoints on a 20-prompt Brazilian Portuguese ASR intelligibility set. Lower is better.

ModelWERCER
base OmniVoice0.04560.0400
v1 checkpoint-190000.04560.0400
v1.5 checkpoint-50000.04000.0379
v1.5 checkpoint-80000.04630.0404
v1.5 checkpoint-90000.04000.0379
v1.5 checkpoint-100000.04710.0390

checkpoint-9000 was selected because it tied for the best ASR score while being later in the refinement run than checkpoint-5000.

Samples

Reference audio was provided for sample generation and is included for reproducibility:

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/liam_reference.mp3"></audio>

Open reference MP3

01 Welcome

Prompt: Bom dia. Esta é uma demonstração em português brasileiro com voz clara e natural.

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/01_welcome.wav"></audio>

Open WAV

02 Creator

Prompt: Hoje eu vou mostrar uma novidade rápida, simples e muito fácil de acompanhar.

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/02_creator.wav"></audio>

Open WAV

03 Brazil

Prompt: São Paulo amanheceu com chuva, mas a cidade continuou cheia de energia.

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/03_brazil.wav"></audio>

Open WAV

04 Food

Prompt: Eu gostaria de um café sem açúcar e um pão de queijo bem quentinho, por favor.

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/04_food.wav"></audio>

Open WAV

06 Product

Prompt: Este produto foi feito para criadores que precisam gravar conteúdos todos os dias.

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/06_product.wav"></audio>

Open WAV

07 Numbers

Prompt: O preço final ficou em cinquenta e três reais, com entrega para amanhã de manhã.

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/07_numbers.wav"></audio>

Open WAV

08 Story

Prompt: No fim da tarde, a música começou baixinho e todo mundo ficou em silêncio para ouvir.

<audio controls src="https://huggingface.co/edwixx/omnivoice-brpt-v15/resolve/main/samples/08_story.wav"></audio>

Open WAV

Training Details

  • Base model: k2-fsa/OmniVoice
  • Initial v1 checkpoint used for refinement: checkpoint-19000
  • Selected release checkpoint: v1.5 checkpoint-9000
  • Dataset: `edwixx/brazilian-portuguese-TTS`
  • Gold refine set: 12,014 train rows, 260 dev rows after filtering
  • Speakers in selected gold subset: 40
  • Language ID used for OmniVoice compatibility: pt
  • Locale metadata: pt-BR
  • Instruction used in refine data/samples: portuguese accent
  • Refine LR: 5e-6
  • Refine steps: 10,000
  • Selected checkpoint: 9,000
  • Final refine eval loss at step 10,000: 3.93625

Usage

bash
omnivoice-infer   --model edwixx/omnivoice-brpt-v15   --text "Bom dia. Esta é uma demonstração em português brasileiro."   --language pt   --instruct "portuguese accent"   --output brpt_v15.wav

Voice cloning example:

bash
omnivoice-infer   --model edwixx/omnivoice-brpt-v15   --text "Hoje eu vou mostrar uma novidade rápida e fácil de acompanhar."   --language pt   --instruct "portuguese accent"   --ref_audio reference.wav   --output brpt_clone.wav

Limitations

This is an experimental OmniVoice fine-tune. The model uses OmniVoice's generic Portuguese language code (pt) internally; Brazilian Portuguese behavior comes from the fine-tuning data, the gold subset, and consistent prompting. Human listening is still required to judge accent, naturalness, and voice-cloning quality.

Do not use this model for impersonation, deception, fraud, harassment, or cloning voices without consent.

Files

This repo intentionally excludes optimizer and random-state files to keep the release cleaner. Reports are in reports/, and audio examples are in samples/.

Attribution