datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
OpenVideo-Scene-Reasoning
OpenVideo-Scene-Reasoning
OpenVideo-Scene-Reasoning is a video understanding dataset containing 2,894 short video clips, where each sample consists of a 10-second video, five uniformly sampled frames, and a dense scene-level response describing the complete temporal sequence.
Rather than generating captions for individual frames independently, the responses are synthesized by jointly reasoning over the sampled frames to capture temporal progression, object interactions, actions… See the full description on the dataset page: https://huggingface.co/datasets/prithivMLmods/OpenVideo-Scene-Reasoning.OpenVID-Cotracker每个生成的 .npz 文件包含以下两个数组:
tracks :
含义 :点的运动轨迹坐标。
形状 (Shape) : (1, T, N, 2)
1 : Batch size (默认为 1)。
T : 视频的总帧数。
N : 采样点的数量(这里是30)。
2 : 每个点的坐标 (x, y) 。
visibility :
含义 :点的可见性掩码。
形状 (Shape) : (1, T, N)
1 : Batch size。
T : 视频的总帧数。
N : 采样点的数量。
数值 :通常为布尔值或 0/1,代表该点在当前帧是否被遮挡或移出画面。
