ThiThanhChuong/precision-voice
0
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
PrecisionVoice - STT & Speaker Diarization
A production-ready Speech-to-Text and Speaker Diarization web application using FastAPI, faster-whisper, and pyannote.audio.
Features
- ๐๏ธ Speech-to-Text using
erax-ai/EraX-WoW-Turbo-V1.1-CT2(8x faster, 8 Vietnamese dialects) - ๐ฅ Speaker Diarization using
pyannote/speaker-diarization-3.1 - ๐งผ Speech Enhancement using
SpeechBrain SepFormer DNS4(noise + reverb removal) - ๐ Voice Activity Detection using
Silero VAD v5(prevents hallucination) - ๐ค Vocal Isolation using
MDX-Net(UVR-MDX-NET-Voc_FT) - ๐ Automatic speaker-transcript alignment
- ๐ฅ Download results in TXT or SRT format
- ๐ณ Docker-ready with persistent model caching and GPU support
- ๐ณ Docker-ready with persistent model caching and GPU support
Quick Start
Prerequisites
- Docker and Docker Compose
- (Optional) NVIDIA GPU with CUDA support
- HuggingFace account with access to pyannote models
Setup
- Clone and configure:
cp .env.example .env
# Edit .env and add your HuggingFace token- Build and run:
docker compose up --build- Open http://localhost:8000
Audio Processing Pipeline
The system uses a state-of-the-art multi-stage pipeline to ensure maximum accuracy:
- Speech Enhancement: Background noise and reverb are removed using
SpeechBrain SepFormer(DNS4 Challenge winner). - Vocal Isolation: Vocals are separated from background music using
MDX-Net. - VAD Filtering: Silence is removed using
Silero VAD v5to prevent ASR hallucination. - Refinement: Highpass filtering and EBU R128 loudness normalization.
- Transcription: High-precision Vietnamese transcription using
PhoWhisper. - Diarization: Segmenting audio by speaker using
Pyannote 3.1. - Alignment: Merging transcripts with speaker segments + timestamp reconstruction.
Configuration
Development
Local Setup (without Docker)
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
uvicorn app.main:app --reloadAPI Endpoints
Supported Audio Formats
- MP3
- WAV
- M4A
- OGG
License
MIT
