CoolFace
Apppublic

Agents-MCP-Hackathon/VTS

sourceHugging Facemitupdated 1y agoView on Hugging Face
1likes
App README

๐ŸŽ™๏ธ Professional Audio/Video AI Suite

Hackathon Track: Agent-Demo-Track Gradio Agents & MCP Hackathon 2025

๐ŸŒŸ Overview

The Professional Audio/Video AI Suite is an advanced AI-powered application that transforms audio and video content through intelligent processing. This comprehensive tool demonstrates the power of AI agents by seamlessly integrating multiple AI models, speech recognition, and text-to-speech capabilities to provide 10+ specialized content processing services.

![Watch the Demo](https://youtu.be/zRT_rbrpGqc)

๐Ÿ”” Note โ€“ Only English audio/video is supported. Videos must be under 60 seconds.

๐ŸŽฏ Key Features

๐Ÿค– Multi-Agent AI Processing

  • โ€”Dual AI Model Support: Google Gemini 1.5 Flash & DeepSeek R1
  • โ€”Intelligent Service Selection: 10 specialized AI agents for different content types
  • โ€”Context-Aware Processing: Each agent optimized for specific use cases

๐ŸŒ Multilingual Capabilities

  • โ€”11 Language Support: Hindi, Nepali, Spanish, French, German, Chinese, Japanese, Korean, Arabic, Russian, Portuguese
  • โ€”Real-time Translation: Instant translation with audio output generation
  • โ€”Cross-language Summaries: AI-powered multilingual content summaries

๐Ÿ“Š Professional Content Processing

  • โ€”Structured Output Formatting: Service-specific professional layouts
  • โ€”Multiple Content Types: Audio (.wav, .mp3, .ogg, .webm, .flac) and Video (.mp4, .mov, .avi, .mkv)
  • โ€”Intelligent Transcription: Advanced speech recognition with noise filtering

๐Ÿ› ๏ธ Available AI Services

ServiceDescriptionOutput Format
๐Ÿ“ Summarize in EnglishQuick content overviewsClean paragraphs
๐Ÿ“‹ Auto Note GeneratorStructured key pointsNumbered sections
๐ŸŽฏ Presentation GeneratorOrganized outlinesMain points & sub-points
๐ŸŒ Language TranslationMulti-language conversionText + Audio output
๐ŸŒ Multilingual AI SummariesSummaries in target languageFormatted content
๐Ÿง  Mental Health CompanionSupportive insightsWisdom sections
๐Ÿ“ฐ Reel-to-Article GeneratorBlog post conversionArticle structure
๐Ÿ” AI Content AnalyzerDeep content analysisCategorized insights
๐Ÿ’ก Idea GeneratorCreative suggestionsNumbered ideas
โœ๏ธ AI GhostwriterProfessional enhancementPolished content

๐Ÿš€ Technical Architecture

AI Agent Framework

User Input โ†’ Speech Recognition โ†’ AI Agent Selection โ†’ Content Processing โ†’ Professional Formatting โ†’ Output Generation

Core Technologies

  • โ€”Frontend: Gradio 4.44.0 with custom CSS styling
  • โ€”Speech Processing: Google Speech Recognition API
  • โ€”AI Models:
  • โ€”Google Gemini 1.5 Flash (Fast processing)
  • โ€”DeepSeek R1 (Detailed analysis)
  • โ€”Text-to-Speech: Google Text-to-Speech (gTTS)
  • โ€”Media Processing: FFmpeg for video-to-audio conversion

Smart Features

  • โ€”Adaptive Language Detection: Automatic service-based language dropdown
  • โ€”Professional Text Formatting: Service-specific output structures
  • โ€”Error Handling: Comprehensive validation and user feedback
  • โ€”File Management: Temporary file cleanup and optimization

๐Ÿ“ฑ User Experience

Intuitive Interface

  • โ€”Drag & Drop Upload: Easy file selection
  • โ€”Smart Service Selection: Context-aware options
  • โ€”Real-time Processing: Live status updates
  • โ€”Professional Results: Clean, formatted output

Accessibility Features

  • โ€”Responsive Design: Works on all devices
  • โ€”Clear Visual Hierarchy: Professional styling
  • โ€”Copy Functionality: Easy content sharing
  • โ€”Audio Playback: Generated audio for translations

๐ŸŽฅ Demo Video

**Watch Demo Video**

The demo showcases:

  • โ€”File upload and processing workflow
  • โ€”Multiple AI service demonstrations
  • โ€”Multilingual translation with audio output
  • โ€”Professional formatting examples
  • โ€”Real-time processing capabilities

๐Ÿ† Hackathon Relevance

Agent-Demo-Track Alignment

This application perfectly demonstrates the power of AI agents through:

  1. 1.Multi-Agent Architecture: 10 specialized AI agents for different content types
  2. 2.Intelligent Routing: Smart service selection based on user needs
  3. 3.Context Awareness: Each agent optimized for specific use cases
  4. 4.Professional Output: Service-specific formatting and structure
  5. 5.Real-world Applications: Practical solutions for content creators, educators, and professionals

Innovation Highlights

  • โ€”Seamless Integration: Multiple AI models working together
  • โ€”Professional Formatting: Service-specific output structures
  • โ€”Multilingual Support: 11 languages with audio generation
  • โ€”User-Centric Design: Intuitive interface with professional results

๐Ÿš€ Getting Started

Prerequisites

bash
pip install gradio google-generativeai openai speech-recognition gtts python-dotenv