Video-R1/Video-R1-data
This repository contains the data presented in Video-R1: Reinforcing Video Reasoning in MLLMs. Code: https://github.com/tulerfeng/Video-R1 Video data folder: CLEVRER, LLaVA-Video-178K, NeXT-QA, PerceptionTest, STAR Image data folder: Chart, General, Knowledge, Math, OCR, Spatial Video-R1-COT-165k.json is for SFT cold start, and Video-R1-260k.json is for RL training. Data Format in Video-R1-COT-165k: { "problem_id": 2, "problem": "What appears on the screen in Russian during the… See the full description on the dataset page: https://huggingface.co/datasets/Video-R1/Video-R1-data.
244.6k
1---2license: apache-2.03task_categories:4- video-text-to-text5language:6- en7size_categories:8- 100K<n<1M9---10 11This repository contains the data presented in [Video-R1: Reinforcing Video Reasoning in MLLMs](https://huggingface.co/papers/2503.21776).12 13Code: https://github.com/tulerfeng/Video-R114 15Video data folder: CLEVRER, LLaVA-Video-178K, NeXT-QA, PerceptionTest, STAR16 17Image data folder: Chart, General, Knowledge, Math, OCR, Spatial18 19Video-R1-COT-165k.json is for SFT cold start, and Video-R1-260k.json is for RL training.20 21Data Format in Video-R1-COT-165k:22 23```24 {25 "problem_id": 2,26 "problem": "What appears on the screen in Russian during the missile's ascent?",27 "data_type": "video",28 "problem_type": "multiple choice",29 "options": [30 "A. A YouTube subscription notification",31 "B. A military command",32 "C. A warning message",33 "D. A weather update"34 ],35 "process": "<think>Let me think about this for a moment. The video shows a missile being launched, and there's a pop-up that appears in Russian during the missile's ascent. Hmm, what could it be? Wait, it looks familiar. It resembles something I've seen before online.\n\nOh, I see! It's a YouTube pop-up, specifically a notification that says \"Вы подписаны,\" which translates to \"You are subscribed.\" This is a common feature on YouTube when someone subscribes to a channel. Let's break it down: it's not a military command, a warning message, or a weather update—it's clearly related to YouTube.\n\nSo, after some self-reflection and verification, I'm confident that the pop-up is indeed a YouTube subscription notification.</think>",36 "solution": "<answer>A</answer>",37 "path": "./LLaVA-Video-178K/liwei_youtube_videos/videos/youtube_video_2024/ytb_7nRmsEw7nsE.mp4",38 "data_source": "LLaVA-Video-178K/30_60_s_youtube_v0_1"39 }40```