CoolFace
Apppublic

LuciferVid/Custom_VoiceBot

sourceHugging Faceupdated 4mo agoView on Hugging Face
0likes
App README

Intelligence Core: Voice RAG System

An enterprise-grade, high-performance RAG (Retrieval-Augmented Generation) ecosystem powered by Google Gemini. This system enables professional-grade document analysis through a sophisticated, minimal voice interface.

System Architecture

๐Ÿง  Intelligence & Synthesis

  • โ€”Core Reasoning: Google Gemini 2.0 Flash for context-aware generation and rephrasing.
  • โ€”Vector Embeddings: Cloud-native text-embedding-004 for zero-latency, high-dimensional semantic search.
  • โ€”Voice Pipeline: Bidirectional audio processing using Gemini STT and high-fidelity gTTS.

โšก Performance & Stability

  • โ€”Multi-User Session Isolation: Advanced UUID-based workspace isolation ensuring total privacy and independent context for every user.
  • โ€”API Resilience Engine: Native exponential backoff and retry logic for high-availability document indexing under peak load.
  • โ€”Automated Maintenance: Intelligent background pruning tasks for session memory and disk space management (24h TTL).
  • โ€”Multi-File Concurrent Sync: Optimized for simultaneous processing of multiple documents without performance degradation.
  • โ€”Thread-Safe Architecture: Implemented system-wide locking for the FAISS engine to prevent context corruption during concurrent writes.
  • โ€”Cloud-Native Design: Replaced local heavy ML dependencies with cloud APIs, reducing memory footprint by 90% (<50MB RAM).
  • โ€”Stateless Stability: Optimized for high-availability deployment on containerized environments like Render.

๐Ÿ“ Data Handling

  • โ€”Multi-Format Support: Native extraction for PDF, DOCX, TXT, and MD.
  • โ€”Context Management: Adaptive sliding-window chunking logic for precise retrieval.
  • โ€”Vector Storage: Isolated, session-specific FAISS indices with thread-safe persistence.

Quick Connection

1. Requirements

Create a .env configuration file:

env
GEMINI_API_KEY=your_production_key

2. Infrastructure Setup

bash
pip install -r requirements.txt

3. Execution

Engine (Backend):

bash
python main.py

Interface (Frontend):

bash
streamlit run frontend/app.py

Production Deployment

The system is architected for zero-configuration deployment:

  • โ€”Backend: Render (Python/Uvicorn)
  • โ€”Frontend: Streamlit Community Cloud

Technical Documentation by [LuciferVid](https://github.com/LuciferVid)