interaction
seamless-interaction
Seamless Interaction Dataset
A large-scale multimodal dataset of 4,000+ hours of human interactions for AI research
🖼️ Blog
🌐 Website
🎮 Demo
📦 GitHub
📄 Paper
Human communication involves a complex interplay of verbal and nonverbal signals, essential for conveying meaning and achieving interpersonal goals.
The Seamless Interaction Dataset is a large-scale collection of over 4,000 hours of face-to-face interaction footage from more than 4,000 participants in… See the full description on the dataset page: https://huggingface.co/datasets/facebook/seamless-interaction.PhysicalAI-WorldModel-Synthetic-Physical-Interaction-Scenes
PhysicalAI-WorldModel-Synthetic-Physical-Interaction-Scenes Dataset Card
Dataset Description
PhysicalAI-WorldModel-Synthetic-Physical-Interaction-Scenes is a large-scale synthetic dataset of physically-simulated multi-object interaction scenes, generated using NVIDIA Isaac Sim and the PhysX physics engine. It is designed to train and evaluate AI models on physical reasoning, rigid body dynamics, optical flow, depth estimation, and scene understanding.
Each clip… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-WorldModel-Synthetic-Physical-Interaction-Scenes.Beta-Hybrid-Interaction-SFTInteraction2Code
Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototyping
Project Page | Paper | GitHub
Interaction2Code is the first systematic investigation and benchmark for Multimodal Large Language Models (MLLMs) in generating interactive webpages. While existing benchmarks focus on static UI-to-code tasks, Interaction2Code encompasses 127 unique webpages and 374 distinct interactions across 15 webpage types and 31 interaction categories to… See the full description on the dataset page: https://huggingface.co/datasets/whale99/Interaction2Code.Interaction-videos
Interaction — 源视频
interaction 复现所用的源视频/片段（未抽帧）。抽好帧的版本见配套仓库 momo321654/interaction-frames。
~70 万视频/片段，跨 ~40 个源（Kinetics / Live-WhisperX / EgoIT / Molmo2 / TimeLens / CharadesEgo / Vript / TGIF / GUI-World …）
含：本地动作识别库、流式解说、自我中心切片、YouTube 下载片段、动图 GIF 等
文件结构
data/<源>__NNN.tar — 按源切的 ≤10G 独立分片（每片可单独解压）
解压：tar xf <源>__NNN.tar → 得到 videos_pool/<源>/<视频文件>
视频名与 frames 仓库 processed_data/*.json 的 video_name 对应
seamless-interaction-jefferson-annotations
Seamless Interaction Jefferson-Style Annotations
An automatic, turn-oriented annotation layer for the
Meta Seamless Interaction Dataset.
It compares the dataset's traditional transcript with an ASR-derived
Jefferson-style condition and supplies speech-act, communicative-purpose,
interactional-signal, alignment, and quality fields.
This is a derived noncommercial research dataset. It does not redistribute
the source audio. Every record retains the original interaction ID, split… See the full description on the dataset page: https://huggingface.co/datasets/kennethli319/seamless-interaction-jefferson-annotations.