allenai/Molmo2-VideoTrack
Molmo2-VideoTrack Molmo2-VideoTrack is a dataset of video point tracking annotations collected from human annotators across 16 video datasets. It can be used to fine-tune vision-language models for video object tracking via point trajectories. Molmo2-VideoTrack is part of the Molmo2 dataset collection and was used to train the Molmo2 family of models. Quick links: 📃 Paper 🎥 Blog with Videos Usage from datasets import load_dataset # Load entire dataset ds =… See the full description on the dataset page: https://huggingface.co/datasets/allenai/Molmo2-VideoTrack.
Molmo2-VideoTrack
Molmo2-VideoTrack is a dataset of video point tracking annotations collected from human annotators across 16 video datasets. It can be used to fine-tune vision-language models for video object tracking via point trajectories.
Molmo2-VideoTrack is part of the Molmo2 dataset collection and was used to train the Molmo2 family of models.
Quick links:
Usage
from datasets import load_dataset
# Load entire dataset
ds = load_dataset("allenai/Molmo2-VideoTrack", split="train")
# Filter by video dataset
dancetrack = ds.filter(lambda x: x == 'dancetrack', input_columns='video_dataset')Data Format
Each row contains tracking annotations for one or more objects in a video clip:
Important: start_frame and end_frame indicate which portion of the source video to use. You need to trim the video to this range — the annotations correspond to frames within [start_frame, end_frame], not the entire video.
Folder Structure
Molmo2-VideoTrack/
├── README.md
└── data/
├── animaltrack/
│ └── point_tracks.parquet
├── APTv2/
│ └── point_tracks.parquet
├── ...
└── {video_dataset}/
└── point_tracks.parquetVideo Sources
The table below contains information on the sources of the third party datasets used or referenced in curating the data for Molmo2-VideoTrack. We do not provide video files or share the original raw data from datasets with restrictions on use and distribution according to the source license. We instead provide the links, license information, and notes for downloading videos from the original datasets for transparency and reproducibility. Please verify the licenses and use requirements that apply to each dataset before downloading as they may change or be updated by the dataset providers.
License
This dataset is licensed under ODC-BY-1.0. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines. Please refer to the Video Sources section for the original datasets that provide the videos used to generate the segmentations and point tracks for this dataset. All use of the videos and original data from these datasets are subject to the licenses and terms of use provided by the sources. Please check the sources to determine if they are appropriate for your use case.