CoolFace
Apppublic

RSHVR/Command_RTC

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes
README.md57 linesDownload Raw Back to root
1---2title: Command_RTC3emoji: 🦀4colorFrom: yellow5colorTo: purple6sdk: gradio7sdk_version: 5.32.18app_file: app.py9pinned: false10license: apache-2.011short_description: Text-to-speech using Gradio, FastAPI, and Chatterbox TTS12tags:13- chatterbox-tts14- text-to-speech15- voice-cloning16- gradio17- fastapi18---19 20# Voice Chat Assistant21A conversational voice assistant powered by AI that responds to your spoken queries with natural-sounding speech.22 23## Features24 25- Speech Recognition: Uses OpenAI's Whisper model to accurately transcribe your voice26- Natural Language Understanding: Leverages Cohere's LLM API for intelligent responses27- Text-to-Speech: Generates natural speech using Chatterbox-TTS28- Reply on Pause: Automatically responds when you finish speaking29- Conversation History: Maintains context throughout your dialogue30 31## Demo32Speak into your microphone and the assistant will respond with voice!33 34## How It Works35- Your voice is transcribed to text using Whisper36- The text is processed by Cohere's LLM to generate a response37- The response is converted to speech using Chatterbox-TTS38- The conversation continues with full context retention39 40## Technical Details41 42This project utilizes:43 44- Zero-GPU: Efficient GPU memory usage with Hugging Face's Zero-GPU technology45- FastRTC: Real-time communication for seamless voice interaction46- Gradio: Simple and intuitive user interface47 48## Setup49 50To run this locally, you'll need a Cohere API key and Python 3.8+.51 52## Acknowledgements53 54- OpenAI for the Whisper speech recognition model55- Cohere for the language model API56- Tortoise-TTS for the text-to-speech capabilities57- Hugging Face for the Spaces and Zero-GPU infrastructure