AnTo2209/MarineEVT
MarineEVT Dataset MarineEVT: Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoning 📖 Description MarineEVT is a comprehensive event-centric dataset and benchmark for marine video understanding. It comprises 20,000 richly annotated underwater video question-answer pairs spanning 20 fine-grained dimensions, designed to support semantic, contextualized, spatial-temporal, and causal reasoning in marine environments. The dataset addresses the… See the full description on the dataset page: https://huggingface.co/datasets/AnTo2209/MarineEVT.
01.5k
1{2 "data": [3 {4 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",5 "answer": "A pufferfish acts as a referee in a territorial dispute between two other fish. This is unusual because pufferfish typically do not mediate or observe aggressive interactions between other species; their role as a passive observer in a social conflict is rare and not commonly documented in marine behavior.",6 "dimension": "SemanticReasoning",7 "subdimension": "AbnormalEventSummarization",8 "question_task": "VideoSummarization",9 "question_format": "Open-endQuestion",10 "video_id": "99z6NHHk7ne2",11 "video_url": "https://www.instagram.com/onebreathdiver/reel/DHzBzsfT2M3",12 "video_scene": "000003_000017",13 "id": 0,14 "original_video_id": "DHzBzsfT2M3",15 "turns": [16 {17 "id": 0,18 "turn_id": 1,19 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",20 "assistant_response": "<answer>A pufferfish acts as a referee in a territorial dispute between two other fish. This is unusual because pufferfish typically do not mediate or observe aggressive interactions between other species; their role as a passive observer in a social conflict is rare and not commonly documented in marine behavior.</answer>",21 "visual_input": [22 "frames/frame_000000.jpg",23 "frames/frame_000001.jpg",24 "frames/frame_000002.jpg",25 "frames/frame_000003.jpg",26 "frames/frame_000004.jpg",27 "frames/frame_000005.jpg",28 "frames/frame_000006.jpg",29 "frames/frame_000007.jpg",30 "frames/frame_000008.jpg",31 "frames/frame_000009.jpg",32 "frames/frame_000010.jpg",33 "frames/frame_000011.jpg",34 "frames/frame_000012.jpg",35 "frames/frame_000013.jpg",36 "frames/frame_000014.jpg"37 ]38 }39 ]40 },41 {42 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",43 "answer": "A diver is swimming in close proximity to a humpback whale without any apparent provocation or danger. This is unusual because humpback whales, despite their massive size and power, rarely exhibit such calm and non-aggressive behavior toward humans, making this interaction atypical and uncommon in marine wildlife encounters.",44 "dimension": "SemanticReasoning",45 "subdimension": "AbnormalEventSummarization",46 "question_task": "VideoSummarization",47 "question_format": "Open-endQuestion",48 "video_id": "4OUpXLBeAYks",49 "video_url": "https://www.instagram.com/nadia.aly.photo/reel/Btn4zgeActj",50 "video_scene": "000000_000002",51 "id": 1,52 "original_video_id": "Btn4zgeActj",53 "turns": [54 {55 "id": 1,56 "turn_id": 1,57 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",58 "assistant_response": "<answer>A diver is swimming in close proximity to a humpback whale without any apparent provocation or danger. This is unusual because humpback whales, despite their massive size and power, rarely exhibit such calm and non-aggressive behavior toward humans, making this interaction atypical and uncommon in marine wildlife encounters.</answer>",59 "visual_input": [60 "frames/frame_000000.jpg",61 "frames/frame_000001.jpg",62 "frames/frame_000002.jpg"63 ]64 }65 ]66 },67 {68 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",69 "answer": "The Double-spot Octopus changes its skin color and texture to blend with the sandy ocean floor. This is unusual because such precise and rapid camouflage behavior, especially under low-light conditions, is rarely observed in real-time underwater footage.",70 "dimension": "SemanticReasoning",71 "subdimension": "AbnormalEventSummarization",72 "question_task": "VideoSummarization",73 "question_format": "Open-endQuestion",74 "video_id": "1au1A6zLfnSr",75 "video_url": "https://www.instagram.com/onebreathdiver/reel/CaK_PxcBjxn",76 "video_scene": "000000_000043",77 "id": 2,78 "original_video_id": "CaK_PxcBjxn",79 "turns": [80 {81 "id": 2,82 "turn_id": 1,83 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",84 "assistant_response": "<answer>The Double-spot Octopus changes its skin color and texture to blend with the sandy ocean floor. This is unusual because such precise and rapid camouflage behavior, especially under low-light conditions, is rarely observed in real-time underwater footage.</answer>",85 "visual_input": [86 "frames/frame_000000.jpg",87 "frames/frame_000001.jpg",88 "frames/frame_000002.jpg",89 "frames/frame_000003.jpg",90 "frames/frame_000004.jpg",91 "frames/frame_000005.jpg",92 "frames/frame_000006.jpg",93 "frames/frame_000007.jpg",94 "frames/frame_000008.jpg",95 "frames/frame_000009.jpg",96 "frames/frame_000010.jpg",97 "frames/frame_000011.jpg",98 "frames/frame_000012.jpg",99 "frames/frame_000013.jpg",100 "frames/frame_000014.jpg",101 "frames/frame_000015.jpg",102 "frames/frame_000016.jpg",103 "frames/frame_000017.jpg",104 "frames/frame_000018.jpg",105 "frames/frame_000019.jpg",106 "frames/frame_000020.jpg",107 "frames/frame_000021.jpg",108 "frames/frame_000022.jpg",109 "frames/frame_000023.jpg",110 "frames/frame_000024.jpg",111 "frames/frame_000025.jpg",112 "frames/frame_000026.jpg",113 "frames/frame_000027.jpg",114 "frames/frame_000028.jpg",115 "frames/frame_000029.jpg",116 "frames/frame_000030.jpg",117 "frames/frame_000031.jpg",118 "frames/frame_000032.jpg",119 "frames/frame_000033.jpg",120 "frames/frame_000034.jpg",121 "frames/frame_000035.jpg",122 "frames/frame_000036.jpg",123 "frames/frame_000037.jpg",124 "frames/frame_000038.jpg",125 "frames/frame_000039.jpg",126 "frames/frame_000040.jpg",127 "frames/frame_000041.jpg",128 "frames/frame_000042.jpg",129 "frames/frame_000043.jpg"130 ]131 }132 ]133 },134 {135 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",136 "answer": "An octopus is interacting with a human diver's equipment, possibly using it as a tool or object of curiosity. This is unusual because octopuses typically do not engage with human-made objects in such a deliberate manner, especially in natural underwater settings where they are more likely to avoid or hide from unfamiliar items.",137 "dimension": "SemanticReasoning",138 "subdimension": "AbnormalEventSummarization",139 "question_task": "VideoSummarization",140 "question_format": "Open-endQuestion",141 "video_id": "3lhAB7gvNtcw",142 "video_url": "",143 "video_scene": "000460_000462",144 "id": 3,145 "original_video_id": "woTi--GCzwM",146 "missing_video": true,147 "turns": [148 {149 "id": 3,150 "turn_id": 1,151 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",152 "assistant_response": "<answer>An octopus is interacting with a human diver's equipment, possibly using it as a tool or object of curiosity. This is unusual because octopuses typically do not engage with human-made objects in such a deliberate manner, especially in natural underwater settings where they are more likely to avoid or hide from unfamiliar items.</answer>",153 "visual_input": [154 "frames/frame_000000.jpg",155 "frames/frame_000001.jpg",156 "frames/frame_000002.jpg"157 ]158 }159 ]160 },161 {162 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",163 "answer": "The flatfish buries itself completely in the sand, revealing only its eyes and mouth. This is unusual because such precise and effective camouflage behavior\u2014where the fish remains motionless and perfectly blends into the substrate\u2014is rarely observed in real-time with such clarity in natural marine environments.",164 "dimension": "SemanticReasoning",165 "subdimension": "AbnormalEventSummarization",166 "question_task": "VideoSummarization",167 "question_format": "Open-endQuestion",168 "video_id": "I0zFCGDCXHuO",169 "video_url": "https://www.instagram.com/romanhurghada/reel/CM9EEkolZ5v",170 "video_scene": "000000_000025",171 "id": 4,172 "original_video_id": "CM9EEkolZ5v",173 "turns": [174 {175 "id": 4,176 "turn_id": 1,177 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",178 "assistant_response": "<answer>The flatfish buries itself completely in the sand, revealing only its eyes and mouth. This is unusual because such precise and effective camouflage behavior\u2014where the fish remains motionless and perfectly blends into the substrate\u2014is rarely observed in real-time with such clarity in natural marine environments.</answer>",179 "visual_input": [180 "frames/frame_000000.jpg",181 "frames/frame_000001.jpg",182 "frames/frame_000002.jpg",183 "frames/frame_000003.jpg",184 "frames/frame_000004.jpg",185 "frames/frame_000005.jpg",186 "frames/frame_000006.jpg",187 "frames/frame_000007.jpg",188 "frames/frame_000008.jpg",189 "frames/frame_000009.jpg",190 "frames/frame_000010.jpg",191 "frames/frame_000011.jpg",192 "frames/frame_000012.jpg",193 "frames/frame_000013.jpg",194 "frames/frame_000014.jpg",195 "frames/frame_000015.jpg",196 "frames/frame_000016.jpg",197 "frames/frame_000017.jpg",198 "frames/frame_000018.jpg",199 "frames/frame_000019.jpg",200 "frames/frame_000020.jpg",201 "frames/frame_000021.jpg",202 "frames/frame_000022.jpg",203 "frames/frame_000023.jpg",204 "frames/frame_000024.jpg",205 "frames/frame_000025.jpg"206 ]207 }208 ]209 },210 {211 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",212 "answer": "A sea turtle swims extremely close to a scuba diver, gently brushing past her head. This is unusual because sea turtles typically avoid close human contact, making this calm and curious interaction an uncommon and remarkable marine behavior.",213 "dimension": "SemanticReasoning",214 "subdimension": "AbnormalEventSummarization",215 "question_task": "VideoSummarization",216 "question_format": "Open-endQuestion",217 "video_id": "WzefttVpA6Vq",218 "video_url": "https://www.instagram.com/dive_down_under/reel/DSYKto5k5VR",219 "video_scene": "000000_000019",220 "id": 5,221 "original_video_id": "DSYKto5k5VR",222 "turns": [223 {224 "id": 5,225 "turn_id": 1,226 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",227 "assistant_response": "<answer>A sea turtle swims extremely close to a scuba diver, gently brushing past her head. This is unusual because sea turtles typically avoid close human contact, making this calm and curious interaction an uncommon and remarkable marine behavior.</answer>",228 "visual_input": [229 "frames/frame_000000.jpg",230 "frames/frame_000001.jpg",231 "frames/frame_000002.jpg",232 "frames/frame_000003.jpg",233 "frames/frame_000004.jpg",234 "frames/frame_000005.jpg",235 "frames/frame_000006.jpg",236 "frames/frame_000007.jpg",237 "frames/frame_000008.jpg",238 "frames/frame_000009.jpg",239 "frames/frame_000010.jpg",240 "frames/frame_000011.jpg",241 "frames/frame_000012.jpg",242 "frames/frame_000013.jpg",243 "frames/frame_000014.jpg",244 "frames/frame_000015.jpg",245 "frames/frame_000016.jpg",246 "frames/frame_000017.jpg",247 "frames/frame_000018.jpg",248 "frames/frame_000019.jpg"249 ]250 }251 ]252 },253 {254 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",255 "answer": "The octopus displays rapid and dramatic changes in skin color and texture to blend into the coral reef environment. This is unusual because such precise, dynamic camouflage occurs swiftly and is rarely observed in detail in natural underwater settings, especially under varying light conditions.",256 "dimension": "SemanticReasoning",257 "subdimension": "AbnormalEventSummarization",258 "question_task": "VideoSummarization",259 "question_format": "Open-endQuestion",260 "video_id": "GDUSSrlljmB8",261 "video_url": "https://www.instagram.com/romanhurghada/reel/DIuM0_WNrz7",262 "video_scene": "000069_000085",263 "id": 6,264 "original_video_id": "DIuM0_WNrz7",265 "turns": [266 {267 "id": 6,268 "turn_id": 1,269 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",270 "assistant_response": "<answer>The octopus displays rapid and dramatic changes in skin color and texture to blend into the coral reef environment. This is unusual because such precise, dynamic camouflage occurs swiftly and is rarely observed in detail in natural underwater settings, especially under varying light conditions.</answer>",271 "visual_input": [272 "frames/frame_000000.jpg",273 "frames/frame_000001.jpg",274 "frames/frame_000002.jpg",275 "frames/frame_000003.jpg",276 "frames/frame_000004.jpg",277 "frames/frame_000005.jpg",278 "frames/frame_000006.jpg",279 "frames/frame_000007.jpg",280 "frames/frame_000008.jpg",281 "frames/frame_000009.jpg",282 "frames/frame_000010.jpg",283 "frames/frame_000011.jpg",284 "frames/frame_000012.jpg",285 "frames/frame_000013.jpg",286 "frames/frame_000014.jpg",287 "frames/frame_000015.jpg",288 "frames/frame_000016.jpg"289 ]290 }291 ]292 },293 {294 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",295 "answer": "A manatee is entangled in a net. This is unusual because manatees are typically non-aggressive, slow-moving marine mammals that rarely encounter such human-made fishing gear, making this an abnormal and potentially life-threatening event caused by human activity.",296 "dimension": "SemanticReasoning",297 "subdimension": "AbnormalEventSummarization",298 "question_task": "VideoSummarization",299 "question_format": "Open-endQuestion",300 "video_id": "DdEVfbiiEY5x",301 "video_url": "https://www.youtube.com/watch?v=IL38vuAWV8o",302 "video_scene": "002424_002426",303 "id": 7,304 "original_video_id": "IL38vuAWV8o",305 "turns": [306 {307 "id": 7,308 "turn_id": 1,309 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",310 "assistant_response": "<answer>A manatee is entangled in a net. This is unusual because manatees are typically non-aggressive, slow-moving marine mammals that rarely encounter such human-made fishing gear, making this an abnormal and potentially life-threatening event caused by human activity.</answer>",311 "visual_input": [312 "frames/frame_000000.jpg",313 "frames/frame_000001.jpg",314 "frames/frame_000002.jpg"315 ]316 }317 ]318 },319 {320 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",321 "answer": "An alligator is captured mid-leap with its mouth wide open, displaying an unusual vertical breach-like motion. This is unusual because crocodilians typically do not perform vertical breaches; such behavior may indicate a rare feeding or defensive response not commonly observed in natural aquatic settings.",322 "dimension": "SemanticReasoning",323 "subdimension": "AbnormalEventSummarization",324 "question_task": "VideoSummarization",325 "question_format": "Open-endQuestion",326 "video_id": "eamO58RLEsyC",327 "video_url": "https://www.youtube.com/watch?v=st5_OKH1O-g",328 "video_scene": "000016_000016",329 "id": 8,330 "original_video_id": "st5_OKH1O-g",331 "turns": [332 {333 "id": 8,334 "turn_id": 1,335 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",336 "assistant_response": "<answer>An alligator is captured mid-leap with its mouth wide open, displaying an unusual vertical breach-like motion. This is unusual because crocodilians typically do not perform vertical breaches; such behavior may indicate a rare feeding or defensive response not commonly observed in natural aquatic settings.</answer>",337 "visual_input": [338 "frames/frame_000000.jpg"339 ]340 }341 ]342 },343 {344 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",345 "answer": "A hairy scorpionfish remains motionless, camouflaged on the seabed, to ambush a nearby small fish. This is unusual because such precise ambush predation via camouflage is rarely observed in real-time with clear visibility, especially as the predator\u2019s stillness and sudden strike are difficult to capture on video.",346 "dimension": "SemanticReasoning",347 "subdimension": "AbnormalEventSummarization",348 "question_task": "VideoSummarization",349 "question_format": "Open-endQuestion",350 "video_id": "WqdVtQlei99M",351 "video_url": "https://www.instagram.com/ocean_reality/reel/C7Vqmb-PoSd",352 "video_scene": "000012_000013",353 "id": 9,354 "original_video_id": "C7Vqmb-PoSd",355 "turns": [356 {357 "id": 9,358 "turn_id": 1,359 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",360 "assistant_response": "<answer>A hairy scorpionfish remains motionless, camouflaged on the seabed, to ambush a nearby small fish. This is unusual because such precise ambush predation via camouflage is rarely observed in real-time with clear visibility, especially as the predator\u2019s stillness and sudden strike are difficult to capture on video.</answer>",361 "visual_input": [362 "frames/frame_000000.jpg",363 "frames/frame_000001.jpg"364 ]365 }366 ]367 },368 {369 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",370 "answer": "A human is standing underwater in shallow, clear water surrounded by multiple sharks, which swim very close to the person without showing signs of aggression. This is unusual because sharks typically avoid close contact with humans unless provoked or habituated, making such calm, proximity behavior rare and uncharacteristic.",371 "dimension": "SemanticReasoning",372 "subdimension": "AbnormalEventSummarization",373 "question_task": "VideoSummarization",374 "question_format": "Open-endQuestion",375 "video_id": "KXTj7tsdQtLN",376 "video_url": "https://www.youtube.com/watch?v=eCxbVKCRnE4",377 "video_scene": "002720_002731",378 "id": 10,379 "original_video_id": "eCxbVKCRnE4",380 "turns": [381 {382 "id": 10,383 "turn_id": 1,384 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",385 "assistant_response": "<answer>A human is standing underwater in shallow, clear water surrounded by multiple sharks, which swim very close to the person without showing signs of aggression. This is unusual because sharks typically avoid close contact with humans unless provoked or habituated, making such calm, proximity behavior rare and uncharacteristic.</answer>",386 "visual_input": [387 "frames/frame_000000.jpg",388 "frames/frame_000001.jpg",389 "frames/frame_000002.jpg",390 "frames/frame_000003.jpg",391 "frames/frame_000004.jpg",392 "frames/frame_000005.jpg",393 "frames/frame_000006.jpg",394 "frames/frame_000007.jpg",395 "frames/frame_000008.jpg",396 "frames/frame_000009.jpg",397 "frames/frame_000010.jpg",398 "frames/frame_000011.jpg"399 ]400 }401 ]402 },403 {404 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",405 "answer": "A large group of Brown Surgeonfish gathers near the surface and engages in synchronized spawning, with males darkening and releasing gametes in unison. This is unusual because mass spawning events of this scale and coordination are rarely observed in the wild, especially under natural lighting conditions near a submerged structure.",406 "dimension": "SemanticReasoning",407 "subdimension": "AbnormalEventSummarization",408 "question_task": "VideoSummarization",409 "question_format": "Open-endQuestion",410 "video_id": "DdKb4mjWD9PT",411 "video_url": "https://www.instagram.com/big.blue.sea/reel/DMc2qK7toLn",412 "video_scene": "000000_000023",413 "id": 11,414 "original_video_id": "DMc2qK7toLn",415 "turns": [416 {417 "id": 11,418 "turn_id": 1,419 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",420 "assistant_response": "<answer>A large group of Brown Surgeonfish gathers near the surface and engages in synchronized spawning, with males darkening and releasing gametes in unison. This is unusual because mass spawning events of this scale and coordination are rarely observed in the wild, especially under natural lighting conditions near a submerged structure.</answer>",421 "visual_input": [422 "frames/frame_000000.jpg",423 "frames/frame_000001.jpg",424 "frames/frame_000002.jpg",425 "frames/frame_000003.jpg",426 "frames/frame_000004.jpg",427 "frames/frame_000005.jpg",428 "frames/frame_000006.jpg",429 "frames/frame_000007.jpg",430 "frames/frame_000008.jpg",431 "frames/frame_000009.jpg",432 "frames/frame_000010.jpg",433 "frames/frame_000011.jpg",434 "frames/frame_000012.jpg",435 "frames/frame_000013.jpg",436 "frames/frame_000014.jpg",437 "frames/frame_000015.jpg",438 "frames/frame_000016.jpg",439 "frames/frame_000017.jpg",440 "frames/frame_000018.jpg",441 "frames/frame_000019.jpg",442 "frames/frame_000020.jpg",443 "frames/frame_000021.jpg",444 "frames/frame_000022.jpg",445 "frames/frame_000023.jpg"446 ]447 }448 ]449 },450 {451 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",452 "answer": "The octopus is using a large shell as a shelter by wrapping its arms around it. This is unusual because tool use, particularly with non-biological objects like shells, is a rare and intelligent behavior observed in only a few cephalopod species, making it noteworthy in underwater footage.",453 "dimension": "SemanticReasoning",454 "subdimension": "AbnormalEventSummarization",455 "question_task": "VideoSummarization",456 "question_format": "Open-endQuestion",457 "video_id": "0LMFgvAEDUo1",458 "video_url": "https://www.instagram.com/onebreathdiver/reel/CK7Wy2yhaZG",459 "video_scene": "000098_000133",460 "id": 12,461 "original_video_id": "CK7Wy2yhaZG",462 "turns": [463 {464 "id": 12,465 "turn_id": 1,466 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",467 "assistant_response": "<answer>The octopus is using a large shell as a shelter by wrapping its arms around it. This is unusual because tool use, particularly with non-biological objects like shells, is a rare and intelligent behavior observed in only a few cephalopod species, making it noteworthy in underwater footage.</answer>",468 "visual_input": [469 "frames/frame_000000.jpg",470 "frames/frame_000001.jpg",471 "frames/frame_000002.jpg",472 "frames/frame_000003.jpg",473 "frames/frame_000004.jpg",474 "frames/frame_000005.jpg",475 "frames/frame_000006.jpg",476 "frames/frame_000007.jpg",477 "frames/frame_000008.jpg",478 "frames/frame_000009.jpg",479 "frames/frame_000010.jpg",480 "frames/frame_000011.jpg",481 "frames/frame_000012.jpg",482 "frames/frame_000013.jpg",483 "frames/frame_000014.jpg",484 "frames/frame_000015.jpg",485 "frames/frame_000016.jpg",486 "frames/frame_000017.jpg",487 "frames/frame_000018.jpg",488 "frames/frame_000019.jpg",489 "frames/frame_000020.jpg",490 "frames/frame_000021.jpg",491 "frames/frame_000022.jpg",492 "frames/frame_000023.jpg",493 "frames/frame_000024.jpg",494 "frames/frame_000025.jpg",495 "frames/frame_000026.jpg",496 "frames/frame_000027.jpg",497 "frames/frame_000028.jpg",498 "frames/frame_000029.jpg",499 "frames/frame_000030.jpg",500 "frames/frame_000031.jpg",501 "frames/frame_000032.jpg",502 "frames/frame_000033.jpg",503 "frames/frame_000034.jpg",504 "frames/frame_000035.jpg"505 ]506 }507 ]508 },509 {510 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",511 "answer": "A scuba diver holds a speargun in extremely close proximity to a shark. This is unusual because the presence of a weapon near a large apex predator, especially in such intimate proximity, defies typical marine safety protocols and normal human-shark interactions.",512 "dimension": "SemanticReasoning",513 "subdimension": "AbnormalEventSummarization",514 "question_task": "VideoSummarization",515 "question_format": "Open-endQuestion",516 "video_id": "uE4hEWE4NMZs",517 "video_url": "https://www.instagram.com/thejewishdiver/reel/CgkCUMzglXE",518 "video_scene": "000000_000011",519 "id": 13,520 "original_video_id": "CgkCUMzglXE",521 "turns": [522 {523 "id": 13,524 "turn_id": 1,525 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",526 "assistant_response": "<answer>A scuba diver holds a speargun in extremely close proximity to a shark. This is unusual because the presence of a weapon near a large apex predator, especially in such intimate proximity, defies typical marine safety protocols and normal human-shark interactions.</answer>",527 "visual_input": [528 "frames/frame_000000.jpg",529 "frames/frame_000001.jpg",530 "frames/frame_000002.jpg",531 "frames/frame_000003.jpg",532 "frames/frame_000004.jpg",533 "frames/frame_000005.jpg",534 "frames/frame_000006.jpg",535 "frames/frame_000007.jpg",536 "frames/frame_000008.jpg",537 "frames/frame_000009.jpg",538 "frames/frame_000010.jpg",539 "frames/frame_000011.jpg"540 ]541 }542 ]543 },544 {545 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",546 "answer": "A shark is swimming closely beneath a sea turtle, possibly engaging in remora-like cleaning behavior or riding on the turtle\u2019s underside. This is unusual because such interspecies interaction\u2014where a predator or large fish associates closely with a sea turtle\u2014is rarely observed and may indicate symbiosis or opportunistic behavior not commonly documented in nature.",547 "dimension": "SemanticReasoning",548 "subdimension": "AbnormalEventSummarization",549 "question_task": "VideoSummarization",550 "question_format": "Open-endQuestion",551 "video_id": "iZsIir8NvwPn",552 "video_url": "https://www.instagram.com/critter.tracker/reel/CohD8FWKGja",553 "video_scene": "000026_000029",554 "id": 14,555 "original_video_id": "CohD8FWKGja",556 "turns": [557 {558 "id": 14,559 "turn_id": 1,560 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",561 "assistant_response": "<answer>A shark is swimming closely beneath a sea turtle, possibly engaging in remora-like cleaning behavior or riding on the turtle\u2019s underside. This is unusual because such interspecies interaction\u2014where a predator or large fish associates closely with a sea turtle\u2014is rarely observed and may indicate symbiosis or opportunistic behavior not commonly documented in nature.</answer>",562 "visual_input": [563 "frames/frame_000000.jpg",564 "frames/frame_000001.jpg",565 "frames/frame_000002.jpg",566 "frames/frame_000003.jpg"567 ]568 }569 ]570 },571 {572 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",573 "answer": "An octopus is wrapping its tentacles around underwater camera equipment. This is unusual because octopuses typically interact with objects out of curiosity, but rarely engage directly with complex human technology in such a deliberate and tactile manner, especially in open-water filming contexts.",574 "dimension": "SemanticReasoning",575 "subdimension": "AbnormalEventSummarization",576 "question_task": "VideoSummarization",577 "question_format": "Open-endQuestion",578 "video_id": "f4cPcp6sBu2e",579 "video_url": "https://www.instagram.com/onebreathdiver/reel/DPIiS1kkZAy",580 "video_scene": "000000_000007",581 "id": 15,582 "original_video_id": "DPIiS1kkZAy",583 "turns": [584 {585 "id": 15,586 "turn_id": 1,587 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",588 "assistant_response": "<answer>An octopus is wrapping its tentacles around underwater camera equipment. This is unusual because octopuses typically interact with objects out of curiosity, but rarely engage directly with complex human technology in such a deliberate and tactile manner, especially in open-water filming contexts.</answer>",589 "visual_input": [590 "frames/frame_000000.jpg",591 "frames/frame_000001.jpg",592 "frames/frame_000002.jpg",593 "frames/frame_000003.jpg",594 "frames/frame_000004.jpg",595 "frames/frame_000005.jpg",596 "frames/frame_000006.jpg",597 "frames/frame_000007.jpg"598 ]599 }600 ]601 },602 {603 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",604 "answer": "An orca is holding a small, unusual-looking marine creature in its mouth, possibly feeding on it. This is unusual because orcas typically prey on fish, seals, or dolphins, and consuming a squid or similar non-traditional prey is less commonly observed in documented feeding behavior.",605 "dimension": "SemanticReasoning",606 "subdimension": "AbnormalEventSummarization",607 "question_task": "VideoSummarization",608 "question_format": "Open-endQuestion",609 "video_id": "BzFSyrZ4keYA",610 "video_url": "https://www.instagram.com/nadia.aly.photo/reel/DKQR4X3B2NI",611 "video_scene": "000007_000011",612 "id": 16,613 "original_video_id": "DKQR4X3B2NI",614 "turns": [615 {616 "id": 16,617 "turn_id": 1,618 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",619 "assistant_response": "<answer>An orca is holding a small, unusual-looking marine creature in its mouth, possibly feeding on it. This is unusual because orcas typically prey on fish, seals, or dolphins, and consuming a squid or similar non-traditional prey is less commonly observed in documented feeding behavior.</answer>",620 "visual_input": [621 "frames/frame_000000.jpg",622 "frames/frame_000001.jpg",623 "frames/frame_000002.jpg",624 "frames/frame_000003.jpg",625 "frames/frame_000004.jpg"626 ]627 }628 ]629 },630 {631 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",632 "answer": "An octopus is interacting with a human diver's equipment, possibly using it as a tool or object of curiosity. This is unusual because octopuses typically do not engage with human-made objects in such a deliberate manner, especially in natural underwater settings where they are more likely to avoid or hide from unfamiliar items.",633 "dimension": "SemanticReasoning",634 "subdimension": "AbnormalEventSummarization",635 "question_task": "VideoSummarization",636 "question_format": "Open-endQuestion",637 "video_id": "3lhAB7gvNtcw",638 "video_url": "",639 "video_scene": "000460_000462",640 "id": 17,641 "original_video_id": "woTi--GCzwM",642 "missing_video": true,643 "turns": [644 {645 "id": 17,646 "turn_id": 1,647 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",648 "assistant_response": "<answer>An octopus is interacting with a human diver's equipment, possibly using it as a tool or object of curiosity. This is unusual because octopuses typically do not engage with human-made objects in such a deliberate manner, especially in natural underwater settings where they are more likely to avoid or hide from unfamiliar items.</answer>",649 "visual_input": [650 "frames/frame_000000.jpg",651 "frames/frame_000001.jpg",652 "frames/frame_000002.jpg"653 ]654 }655 ]656 },657 {658 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",659 "answer": "Two colorful nudibranchs are engaged in mating behavior, positioning their bodies closely for reproduction. This is unusual because such intimate reproductive interactions between marine gastropods are rarely observed in high detail in their natural habitat, especially with visible anatomical features like rhinophores and cerata during the act.",660 "dimension": "SemanticReasoning",661 "subdimension": "AbnormalEventSummarization",662 "question_task": "VideoSummarization",663 "question_format": "Open-endQuestion",664 "video_id": "Fa3dmLgQhmJg",665 "video_url": "https://www.instagram.com/infinitelyoceanmedia/reel/DHBAko8h7A5",666 "video_scene": "000004_000006",667 "id": 18,668 "original_video_id": "DHBAko8h7A5",669 "turns": [670 {671 "id": 18,672 "turn_id": 1,673 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",674 "assistant_response": "<answer>Two colorful nudibranchs are engaged in mating behavior, positioning their bodies closely for reproduction. This is unusual because such intimate reproductive interactions between marine gastropods are rarely observed in high detail in their natural habitat, especially with visible anatomical features like rhinophores and cerata during the act.</answer>",675 "visual_input": [676 "frames/frame_000000.jpg",677 "frames/frame_000001.jpg",678 "frames/frame_000002.jpg"679 ]680 }681 ]682 },683 {684 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",685 "answer": "The Sea Urchin Crab carries the Upside-Down Jellyfish for protection, demonstrating a symbiotic relationship. This is unusual because such interspecies cooperative behavior, where one species actively transports another for mutual benefit, is rarely observed in marine environments and requires specific ecological conditions to manifest.",686 "dimension": "SemanticReasoning",687 "subdimension": "AbnormalEventSummarization",688 "question_task": "VideoSummarization",689 "question_format": "Open-endQuestion",690 "video_id": "FxQVB4ImnBZR",691 "video_url": "https://www.instagram.com/diveivanov/reel/DQ_uG3GkwWg",692 "video_scene": "000000_000007",693 "id": 19,694 "original_video_id": "DQ_uG3GkwWg",695 "turns": [696 {697 "id": 19,698 "turn_id": 1,699 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",700 "assistant_response": "<answer>The Sea Urchin Crab carries the Upside-Down Jellyfish for protection, demonstrating a symbiotic relationship. This is unusual because such interspecies cooperative behavior, where one species actively transports another for mutual benefit, is rarely observed in marine environments and requires specific ecological conditions to manifest.</answer>",701 "visual_input": [702 "frames/frame_000000.jpg",703 "frames/frame_000001.jpg",704 "frames/frame_000002.jpg",705 "frames/frame_000003.jpg",706 "frames/frame_000004.jpg",707 "frames/frame_000005.jpg",708 "frames/frame_000006.jpg",709 "frames/frame_000007.jpg"710 ]711 }712 ]713 },714 {715 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",716 "answer": "A woman on a boat leans over and interacts directly with a shark swimming near the surface. This is unusual because sharks typically exhibit wariness toward humans, and such calm, close proximity without aggression is atypical behavior.",717 "dimension": "SemanticReasoning",718 "subdimension": "AbnormalEventSummarization",719 "question_task": "VideoSummarization",720 "question_format": "Open-endQuestion",721 "video_id": "fw7v6vyXfKgp",722 "video_url": "https://www.youtube.com/watch?v=jMVziqKUkVI",723 "video_scene": "000283_000287",724 "id": 20,725 "original_video_id": "jMVziqKUkVI",726 "turns": [727 {728 "id": 20,729 "turn_id": 1,730 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",731 "assistant_response": "<answer>A woman on a boat leans over and interacts directly with a shark swimming near the surface. This is unusual because sharks typically exhibit wariness toward humans, and such calm, close proximity without aggression is atypical behavior.</answer>",732 "visual_input": [733 "frames/frame_000000.jpg",734 "frames/frame_000001.jpg",735 "frames/frame_000002.jpg",736 "frames/frame_000003.jpg",737 "frames/frame_000004.jpg"738 ]739 }740 ]741 },742 {743 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",744 "answer": "The octopus is using a shell as a shelter, displaying tool-like behavior by selecting and positioning an object for protection. This is unusual because octopuses are known to use objects for shelter, but the deliberate selection and positioning of a shell in this manner demonstrates advanced problem-solving and tool-use behavior rarely observed in marine environments.",745 "dimension": "SemanticReasoning",746 "subdimension": "AbnormalEventSummarization",747 "question_task": "VideoSummarization",748 "question_format": "Open-endQuestion",749 "video_id": "Japvcz6gtBGl",750 "video_url": "https://www.instagram.com/onebreathdiver/reel/CMdC39rBqjd",751 "video_scene": "000009_000024",752 "id": 21,753 "original_video_id": "CMdC39rBqjd",754 "turns": [755 {756 "id": 21,757 "turn_id": 1,758 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",759 "assistant_response": "<answer>The octopus is using a shell as a shelter, displaying tool-like behavior by selecting and positioning an object for protection. This is unusual because octopuses are known to use objects for shelter, but the deliberate selection and positioning of a shell in this manner demonstrates advanced problem-solving and tool-use behavior rarely observed in marine environments.</answer>",760 "visual_input": [761 "frames/frame_000000.jpg",762 "frames/frame_000001.jpg",763 "frames/frame_000002.jpg",764 "frames/frame_000003.jpg",765 "frames/frame_000004.jpg",766 "frames/frame_000005.jpg",767 "frames/frame_000006.jpg",768 "frames/frame_000007.jpg",769 "frames/frame_000008.jpg",770 "frames/frame_000009.jpg",771 "frames/frame_000010.jpg",772 "frames/frame_000011.jpg",773 "frames/frame_000012.jpg",774 "frames/frame_000013.jpg",775 "frames/frame_000014.jpg",776 "frames/frame_000015.jpg"777 ]778 }779 ]780 },781 {782 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",783 "answer": "A cuttlefish is carrying a flatfish in its tentacles. This is unusual because cuttlefish typically hunt smaller prey like crustaceans or small fish, and carrying a flatfish\u2014especially one of comparable size\u2014is an atypical behavior suggesting opportunistic predation or delayed consumption.",784 "dimension": "SemanticReasoning",785 "subdimension": "AbnormalEventSummarization",786 "question_task": "VideoSummarization",787 "question_format": "Open-endQuestion",788 "video_id": "0VzjxfW16Lrz",789 "video_url": "https://www.instagram.com/onebreathdiver/reel/DDsVLHUzfmZ",790 "video_scene": "000008_000013",791 "id": 22,792 "original_video_id": "DDsVLHUzfmZ",793 "turns": [794 {795 "id": 22,796 "turn_id": 1,797 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",798 "assistant_response": "<answer>A cuttlefish is carrying a flatfish in its tentacles. This is unusual because cuttlefish typically hunt smaller prey like crustaceans or small fish, and carrying a flatfish\u2014especially one of comparable size\u2014is an atypical behavior suggesting opportunistic predation or delayed consumption.</answer>",799 "visual_input": [800 "frames/frame_000000.jpg",801 "frames/frame_000001.jpg",802 "frames/frame_000002.jpg",803 "frames/frame_000003.jpg",804 "frames/frame_000004.jpg",805 "frames/frame_000005.jpg"806 ]807 }808 ]809 },810 {811 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",812 "answer": "An octopus cautiously extends its tentacles toward a human hand underwater. This is unusual because wild cephalopods typically avoid close contact with humans, making such calm and interactive behavior exceptionally rare.",813 "dimension": "SemanticReasoning",814 "subdimension": "AbnormalEventSummarization",815 "question_task": "VideoSummarization",816 "question_format": "Open-endQuestion",817 "video_id": "PuPyxBlvvAFc",818 "video_url": "https://www.instagram.com/onebreathdiver/reel/COy0Pz3h_lR",819 "video_scene": "000053_000107",820 "id": 23,821 "original_video_id": "COy0Pz3h_lR",822 "turns": [823 {824 "id": 23,825 "turn_id": 1,826 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",827 "assistant_response": "<answer>An octopus cautiously extends its tentacles toward a human hand underwater. This is unusual because wild cephalopods typically avoid close contact with humans, making such calm and interactive behavior exceptionally rare.</answer>",828 "visual_input": [829 "frames/frame_000000.jpg",830 "frames/frame_000001.jpg",831 "frames/frame_000002.jpg",832 "frames/frame_000003.jpg",833 "frames/frame_000004.jpg",834 "frames/frame_000005.jpg",835 "frames/frame_000006.jpg",836 "frames/frame_000007.jpg",837 "frames/frame_000008.jpg",838 "frames/frame_000009.jpg",839 "frames/frame_000010.jpg",840 "frames/frame_000011.jpg",841 "frames/frame_000012.jpg",842 "frames/frame_000013.jpg",843 "frames/frame_000014.jpg",844 "frames/frame_000015.jpg",845 "frames/frame_000016.jpg",846 "frames/frame_000017.jpg",847 "frames/frame_000018.jpg",848 "frames/frame_000019.jpg",849 "frames/frame_000020.jpg",850 "frames/frame_000021.jpg",851 "frames/frame_000022.jpg",852 "frames/frame_000023.jpg",853 "frames/frame_000024.jpg",854 "frames/frame_000025.jpg",855 "frames/frame_000026.jpg",856 "frames/frame_000027.jpg",857 "frames/frame_000028.jpg",858 "frames/frame_000029.jpg",859 "frames/frame_000030.jpg",860 "frames/frame_000031.jpg",861 "frames/frame_000032.jpg",862 "frames/frame_000033.jpg",863 "frames/frame_000034.jpg",864 "frames/frame_000035.jpg",865 "frames/frame_000036.jpg",866 "frames/frame_000037.jpg",867 "frames/frame_000038.jpg",868 "frames/frame_000039.jpg",869 "frames/frame_000040.jpg",870 "frames/frame_000041.jpg",871 "frames/frame_000042.jpg",872 "frames/frame_000043.jpg",873 "frames/frame_000044.jpg",874 "frames/frame_000045.jpg",875 "frames/frame_000046.jpg",876 "frames/frame_000047.jpg",877 "frames/frame_000048.jpg",878 "frames/frame_000049.jpg",879 "frames/frame_000050.jpg",880 "frames/frame_000051.jpg",881 "frames/frame_000052.jpg",882 "frames/frame_000053.jpg",883 "frames/frame_000054.jpg"884 ]885 }886 ]887 },888 {889 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",890 "answer": "A scuba diver gently touches and interacts with a large tiger shark in close proximity without provoking aggression. This is unusual because tiger sharks are typically perceived as dangerous predators, and such calm, non-aggressive human-shark interaction at close range is extremely rare and contrary to typical marine behavior expectations.",891 "dimension": "SemanticReasoning",892 "subdimension": "AbnormalEventSummarization",893 "question_task": "VideoSummarization",894 "question_format": "Open-endQuestion",895 "video_id": "2qSLDWNvPWHa",896 "video_url": "https://www.instagram.com/tomparkfilms/reel/B4lDzU_Amq8",897 "video_scene": "000000_000014",898 "id": 24,899 "original_video_id": "B4lDzU_Amq8",900 "turns": [901 {902 "id": 24,903 "turn_id": 1,904 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",905 "assistant_response": "<answer>A scuba diver gently touches and interacts with a large tiger shark in close proximity without provoking aggression. This is unusual because tiger sharks are typically perceived as dangerous predators, and such calm, non-aggressive human-shark interaction at close range is extremely rare and contrary to typical marine behavior expectations.</answer>",906 "visual_input": [907 "frames/frame_000000.jpg",908 "frames/frame_000001.jpg",909 "frames/frame_000002.jpg",910 "frames/frame_000003.jpg",911 "frames/frame_000004.jpg",912 "frames/frame_000005.jpg",913 "frames/frame_000006.jpg",914 "frames/frame_000007.jpg",915 "frames/frame_000008.jpg",916 "frames/frame_000009.jpg",917 "frames/frame_000010.jpg",918 "frames/frame_000011.jpg",919 "frames/frame_000012.jpg",920 "frames/frame_000013.jpg",921 "frames/frame_000014.jpg"922 ]923 }924 ]925 },926 {927 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",928 "answer": "A large, dark-colored fish is in extremely close proximity to a scuba diver, appearing to gently nuzzle or interact with the diver\u2019s mask and face. This is unusual because wild marine animals typically avoid close contact with humans, and such tactile interaction is rarely observed in natural underwater settings.",929 "dimension": "SemanticReasoning",930 "subdimension": "AbnormalEventSummarization",931 "question_task": "VideoSummarization",932 "question_format": "Open-endQuestion",933 "video_id": "wEVj9HTjEaoW",934 "video_url": "https://www.instagram.com/dive_down_under/reel/DCKfGd4IyxF",935 "video_scene": "000003_000003",936 "id": 25,937 "original_video_id": "DCKfGd4IyxF",938 "turns": [939 {940 "id": 25,941 "turn_id": 1,942 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",943 "assistant_response": "<answer>A large, dark-colored fish is in extremely close proximity to a scuba diver, appearing to gently nuzzle or interact with the diver\u2019s mask and face. This is unusual because wild marine animals typically avoid close contact with humans, and such tactile interaction is rarely observed in natural underwater settings.</answer>",944 "visual_input": [945 "frames/frame_000000.jpg"946 ]947 }948 ]949 },950 {951 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",952 "answer": "A male Weedy Seadragon is carrying eggs on its body. This is unusual because in most animal species, females carry and incubate offspring, making this male parental care behavior a rare and notable example of 'daddy day care' in marine biology.",953 "dimension": "SemanticReasoning",954 "subdimension": "AbnormalEventSummarization",955 "question_task": "VideoSummarization",956 "question_format": "Open-endQuestion",957 "video_id": "dTzN9AIveIXx",958 "video_url": "https://www.instagram.com/onebreathdiver/reel/DChswnFidAR",959 "video_scene": "000000_000002",960 "id": 26,961 "original_video_id": "DChswnFidAR",962 "turns": [963 {964 "id": 26,965 "turn_id": 1,966 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",967 "assistant_response": "<answer>A male Weedy Seadragon is carrying eggs on its body. This is unusual because in most animal species, females carry and incubate offspring, making this male parental care behavior a rare and notable example of 'daddy day care' in marine biology.</answer>",968 "visual_input": [969 "frames/frame_000000.jpg",970 "frames/frame_000001.jpg",971 "frames/frame_000002.jpg"972 ]973 }974 ]975 },976 {977 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",978 "answer": "A Maori octopus interacts with a baited hook held by a diver, possibly avoiding or manipulating it. This is unusual because octopuses are known for their intelligence and problem-solving abilities, but direct interaction with fishing gear in such a controlled manner\u2014especially to avoid hooks\u2014is rarely observed in the wild.",979 "dimension": "SemanticReasoning",980 "subdimension": "AbnormalEventSummarization",981 "question_task": "VideoSummarization",982 "question_format": "Open-endQuestion",983 "video_id": "PABiwvxklYRl",984 "video_url": "https://www.instagram.com/onebreathdiver/reel/DEa_SEPzWdp",985 "video_scene": "000000_000009",986 "id": 27,987 "original_video_id": "DEa_SEPzWdp",988 "turns": [989 {990 "id": 27,991 "turn_id": 1,992 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",993 "assistant_response": "<answer>A Maori octopus interacts with a baited hook held by a diver, possibly avoiding or manipulating it. This is unusual because octopuses are known for their intelligence and problem-solving abilities, but direct interaction with fishing gear in such a controlled manner\u2014especially to avoid hooks\u2014is rarely observed in the wild.</answer>",994 "visual_input": [995 "frames/frame_000000.jpg",996 "frames/frame_000001.jpg",997 "frames/frame_000002.jpg",998 "frames/frame_000003.jpg",999 "frames/frame_000004.jpg",1000 "frames/frame_000005.jpg",1001 "frames/frame_000006.jpg",1002 "frames/frame_000007.jpg",1003 "frames/frame_000008.jpg",1004 "frames/frame_000009.jpg"1005 ]1006 }1007 ]1008 },1009 {1010 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1011 "answer": "Divers are collecting underwater debris, including plastic bags and small objects, using gloves and cameras. This is unusual because such direct human intervention to remove pollutants from marine environments is often rare in public documentation, and the visible interaction with marine life while collecting trash highlights an uncommon blend of conservation effort and underwater observation.",1012 "dimension": "SemanticReasoning",1013 "subdimension": "AbnormalEventSummarization",1014 "question_task": "VideoSummarization",1015 "question_format": "Open-endQuestion",1016 "video_id": "BVRI63UqMmgA",1017 "video_url": "https://www.instagram.com/onebreathdiver/reel/CmQMYF4opxT",1018 "video_scene": "000006_000027",1019 "id": 28,1020 "original_video_id": "CmQMYF4opxT",1021 "turns": [1022 {1023 "id": 28,1024 "turn_id": 1,1025 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1026 "assistant_response": "<answer>Divers are collecting underwater debris, including plastic bags and small objects, using gloves and cameras. This is unusual because such direct human intervention to remove pollutants from marine environments is often rare in public documentation, and the visible interaction with marine life while collecting trash highlights an uncommon blend of conservation effort and underwater observation.</answer>",1027 "visual_input": [1028 "frames/frame_000000.jpg",1029 "frames/frame_000001.jpg",1030 "frames/frame_000002.jpg",1031 "frames/frame_000003.jpg",1032 "frames/frame_000004.jpg",1033 "frames/frame_000005.jpg",1034 "frames/frame_000006.jpg",1035 "frames/frame_000007.jpg",1036 "frames/frame_000008.jpg",1037 "frames/frame_000009.jpg",1038 "frames/frame_000010.jpg",1039 "frames/frame_000011.jpg",1040 "frames/frame_000012.jpg",1041 "frames/frame_000013.jpg",1042 "frames/frame_000014.jpg",1043 "frames/frame_000015.jpg",1044 "frames/frame_000016.jpg",1045 "frames/frame_000017.jpg",1046 "frames/frame_000018.jpg",1047 "frames/frame_000019.jpg",1048 "frames/frame_000020.jpg",1049 "frames/frame_000021.jpg"1050 ]1051 }1052 ]1053 },1054 {1055 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1056 "answer": "A seahorse is riding on a piece of plastic debris, using it as a platform while moving through the water. This is unusual because marine animals typically do not use man-made objects as tools or supports; such behavior is not commonly documented and suggests an adaptation to human-induced environmental changes.",1057 "dimension": "SemanticReasoning",1058 "subdimension": "AbnormalEventSummarization",1059 "question_task": "VideoSummarization",1060 "question_format": "Open-endQuestion",1061 "video_id": "gu8cQR9Loj60",1062 "video_url": "https://www.instagram.com/ocean_reality/reel/CsDhZIMuq4A",1063 "video_scene": "000000_000006",1064 "id": 29,1065 "original_video_id": "CsDhZIMuq4A",1066 "turns": [1067 {1068 "id": 29,1069 "turn_id": 1,1070 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1071 "assistant_response": "<answer>A seahorse is riding on a piece of plastic debris, using it as a platform while moving through the water. This is unusual because marine animals typically do not use man-made objects as tools or supports; such behavior is not commonly documented and suggests an adaptation to human-induced environmental changes.</answer>",1072 "visual_input": [1073 "frames/frame_000000.jpg",1074 "frames/frame_000001.jpg",1075 "frames/frame_000002.jpg",1076 "frames/frame_000003.jpg",1077 "frames/frame_000004.jpg",1078 "frames/frame_000005.jpg",1079 "frames/frame_000006.jpg"1080 ]1081 }1082 ]1083 },1084 {1085 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1086 "answer": "A scallop rapidly opens and closes its shell, humorously referred to as 'sneezing.' This is unusual because such sudden, forceful shell movement is not commonly observed in routine marine footage and appears more akin to a reflexive or defensive behavior rather than typical feeding or respiration.",1087 "dimension": "SemanticReasoning",1088 "subdimension": "AbnormalEventSummarization",1089 "question_task": "VideoSummarization",1090 "question_format": "Open-endQuestion",1091 "video_id": "b92yangwHdqQ",1092 "video_url": "https://www.instagram.com/onebreathdiver/reel/Cbch47Fo7bn",1093 "video_scene": "000000_000013",1094 "id": 30,1095 "original_video_id": "Cbch47Fo7bn",1096 "turns": [1097 {1098 "id": 30,1099 "turn_id": 1,1100 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1101 "assistant_response": "<answer>A scallop rapidly opens and closes its shell, humorously referred to as 'sneezing.' This is unusual because such sudden, forceful shell movement is not commonly observed in routine marine footage and appears more akin to a reflexive or defensive behavior rather than typical feeding or respiration.</answer>",1102 "visual_input": [1103 "frames/frame_000000.jpg",1104 "frames/frame_000001.jpg",1105 "frames/frame_000002.jpg",1106 "frames/frame_000003.jpg",1107 "frames/frame_000004.jpg",1108 "frames/frame_000005.jpg",1109 "frames/frame_000006.jpg",1110 "frames/frame_000007.jpg",1111 "frames/frame_000008.jpg",1112 "frames/frame_000009.jpg",1113 "frames/frame_000010.jpg",1114 "frames/frame_000011.jpg",1115 "frames/frame_000012.jpg",1116 "frames/frame_000013.jpg"1117 ]1118 }1119 ]1120 },1121 {1122 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1123 "answer": "An octopus is hatching from its egg and emerging into the water column. This is unusual because octopus hatching events are rarely observed in real time due to the hidden, protected nature of their egg-laying sites and the brief, delicate window of emergence.",1124 "dimension": "SemanticReasoning",1125 "subdimension": "AbnormalEventSummarization",1126 "question_task": "VideoSummarization",1127 "question_format": "Open-endQuestion",1128 "video_id": "259eOoA0sCra",1129 "video_url": "https://www.instagram.com/diveivanov/reel/DGdS8VuT0jP",1130 "video_scene": "000000_000013",1131 "id": 31,1132 "original_video_id": "DGdS8VuT0jP",1133 "turns": [1134 {1135 "id": 31,1136 "turn_id": 1,1137 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1138 "assistant_response": "<answer>An octopus is hatching from its egg and emerging into the water column. This is unusual because octopus hatching events are rarely observed in real time due to the hidden, protected nature of their egg-laying sites and the brief, delicate window of emergence.</answer>",1139 "visual_input": [1140 "frames/frame_000000.jpg",1141 "frames/frame_000001.jpg",1142 "frames/frame_000002.jpg",1143 "frames/frame_000003.jpg",1144 "frames/frame_000004.jpg",1145 "frames/frame_000005.jpg",1146 "frames/frame_000006.jpg",1147 "frames/frame_000007.jpg",1148 "frames/frame_000008.jpg",1149 "frames/frame_000009.jpg",1150 "frames/frame_000010.jpg",1151 "frames/frame_000011.jpg",1152 "frames/frame_000012.jpg",1153 "frames/frame_000013.jpg"1154 ]1155 }1156 ]1157 },1158 {1159 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1160 "answer": "A scuba diver gently holds a red sea slug without provoking any defensive behavior. This is unusual because sea slugs typically flee or display defensive reactions when approached by humans, making this calm, close interaction exceptionally rare in natural underwater settings.",1161 "dimension": "SemanticReasoning",1162 "subdimension": "AbnormalEventSummarization",1163 "question_task": "VideoSummarization",1164 "question_format": "Open-endQuestion",1165 "video_id": "YChgYnx4GyLu",1166 "video_url": "https://www.instagram.com/romanhurghada/reel/Czb6vWutoQY",1167 "video_scene": "000025_000049",1168 "id": 32,1169 "original_video_id": "Czb6vWutoQY",1170 "turns": [1171 {1172 "id": 32,1173 "turn_id": 1,1174 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1175 "assistant_response": "<answer>A scuba diver gently holds a red sea slug without provoking any defensive behavior. This is unusual because sea slugs typically flee or display defensive reactions when approached by humans, making this calm, close interaction exceptionally rare in natural underwater settings.</answer>",1176 "visual_input": [1177 "frames/frame_000000.jpg",1178 "frames/frame_000001.jpg",1179 "frames/frame_000002.jpg",1180 "frames/frame_000003.jpg",1181 "frames/frame_000004.jpg",1182 "frames/frame_000005.jpg",1183 "frames/frame_000006.jpg",1184 "frames/frame_000007.jpg",1185 "frames/frame_000008.jpg",1186 "frames/frame_000009.jpg",1187 "frames/frame_000010.jpg",1188 "frames/frame_000011.jpg",1189 "frames/frame_000012.jpg",1190 "frames/frame_000013.jpg",1191 "frames/frame_000014.jpg",1192 "frames/frame_000015.jpg",1193 "frames/frame_000016.jpg",1194 "frames/frame_000017.jpg",1195 "frames/frame_000018.jpg",1196 "frames/frame_000019.jpg",1197 "frames/frame_000020.jpg",1198 "frames/frame_000021.jpg",1199 "frames/frame_000022.jpg",1200 "frames/frame_000023.jpg",