Hothan/Omni-DuplexEval

Omni-DuplexEval 📖 arXiv | GitHub Omni-DuplexEval is a benchmark for evaluating real-time duplex multimodal interaction. Unlike conventional offline video understanding benchmarks, Omni-DuplexEval focuses on streaming settings where models must continuously process evolving multimodal inputs and decide what to respond and when to respond. The benchmark contains two scenarios: Real-Time Description (RTD): evaluates continuous streaming description ability. Proactive Reminder… See the full description on the dataset page: https://huggingface.co/datasets/Hothan/Omni-DuplexEval.