AI-Talent-Force/dev_caio

ShortSmith v2

Extract the most engaging highlight clips from your videos automatically using AI.

Features

• —Multi-modal analysis (visual + audio + motion)
• —Domain-optimized presets (Sports, Music, Vlogs, etc.)
• —Person-specific filtering
• —Scene-aware clip cutting
• —Trained on Mr. HiSum "Most Replayed" data

Usage

1. 1.Upload a video (up to 500MB, max 1 hour)
2. 2.Select content domain (Sports, Music, Vlogs, etc.)
3. 3.Choose number of clips and duration
4. 4.(Optional) Upload reference image for person filtering
5. 5.Click "Extract Highlights"
6. 6.Download your clips!

Tech Stack

• —Visual: Qwen2-VL-2B (INT4 quantized)
• —Audio: Librosa + Wav2Vec 2.0
• —Face Recognition: InsightFace (SCRFD + ArcFace)
• —Hype Scoring: MLP trained on Mr. HiSum dataset
• —Scene Detection: PySceneDetect

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference