AnTo2209/MarineEVT
MarineEVT Dataset MarineEVT: Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoning 📖 Description MarineEVT is a comprehensive event-centric dataset and benchmark for marine video understanding. It comprises 20,000 richly annotated underwater video question-answer pairs spanning 20 fine-grained dimensions, designed to support semantic, contextualized, spatial-temporal, and causal reasoning in marine environments. The dataset addresses the… See the full description on the dataset page: https://huggingface.co/datasets/AnTo2209/MarineEVT.
01.4k
1{2 "data": [3 {4 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",5 "answer": "A diver is swimming very close to a humpback whale while holding a camera steady, and the whale displays unusually calm behavior toward the human presence. This is unusual because humpback whales typically do not approach humans at such close range without exhibiting signs of stress or avoidance, making this interaction highly atypical in wild marine settings.",6 "dimension": "SemanticReasoning",7 "subdimension": "AbnormalEventSummarization",8 "question_task": "VideoSummarization",9 "question_format": "Open-endQuestion",10 "video_id": "7fCfuk0drRXc",11 "video_url": "https://www.instagram.com/nadia.aly.photo/reel/B1jmcUhldsC",12 "video_scene": "000011_000013",13 "id": 100,14 "original_video_id": "B1jmcUhldsC",15 "turns": [16 {17 "id": 100,18 "turn_id": 1,19 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",20 "assistant_response": "<answer>A diver is swimming very close to a humpback whale while holding a camera steady, and the whale displays unusually calm behavior toward the human presence. This is unusual because humpback whales typically do not approach humans at such close range without exhibiting signs of stress or avoidance, making this interaction highly atypical in wild marine settings.</answer>",21 "visual_input": [22 "frames/frame_000000.jpg",23 "frames/frame_000001.jpg",24 "frames/frame_000002.jpg"25 ]26 }27 ]28 },29 {30 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",31 "answer": "The Two-Stick Stingfish displays its vibrant, patterned fins while camouflaged on the sandy seabed to ambush prey. This is unusual because benthic ambush predators typically rely on stillness and concealment without revealing such striking fin patterns, making this visual display an atypical and deceptive predatory tactic.",32 "dimension": "SemanticReasoning",33 "subdimension": "AbnormalEventSummarization",34 "question_task": "VideoSummarization",35 "question_format": "Open-endQuestion",36 "video_id": "YB6WmYI9afV3",37 "video_url": "https://www.instagram.com/big.blue.sea/reel/C7l9cnat2ci",38 "video_scene": "000000_000013",39 "id": 101,40 "original_video_id": "C7l9cnat2ci",41 "turns": [42 {43 "id": 101,44 "turn_id": 1,45 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",46 "assistant_response": "<answer>The Two-Stick Stingfish displays its vibrant, patterned fins while camouflaged on the sandy seabed to ambush prey. This is unusual because benthic ambush predators typically rely on stillness and concealment without revealing such striking fin patterns, making this visual display an atypical and deceptive predatory tactic.</answer>",47 "visual_input": [48 "frames/frame_000000.jpg",49 "frames/frame_000001.jpg",50 "frames/frame_000002.jpg",51 "frames/frame_000003.jpg",52 "frames/frame_000004.jpg",53 "frames/frame_000005.jpg",54 "frames/frame_000006.jpg",55 "frames/frame_000007.jpg",56 "frames/frame_000008.jpg",57 "frames/frame_000009.jpg",58 "frames/frame_000010.jpg",59 "frames/frame_000011.jpg",60 "frames/frame_000012.jpg",61 "frames/frame_000013.jpg"62 ]63 }64 ]65 },66 {67 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",68 "answer": "An octopus displays dynamic color-changing patterns while interacting closely with divers near a coral reef. This is unusual because such prolonged, visible interaction with humans combined with adaptive camouflage is rarely observed in wild octopuses, especially in deep or open-sea environments.",69 "dimension": "SemanticReasoning",70 "subdimension": "AbnormalEventSummarization",71 "question_task": "VideoSummarization",72 "question_format": "Open-endQuestion",73 "video_id": "ijKcKl9aqT9C",74 "video_url": "https://www.instagram.com/big.blue.sea/reel/Cg85V-wFBMv",75 "video_scene": "000000_000048",76 "id": 102,77 "original_video_id": "Cg85V-wFBMv",78 "turns": [79 {80 "id": 102,81 "turn_id": 1,82 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",83 "assistant_response": "<answer>An octopus displays dynamic color-changing patterns while interacting closely with divers near a coral reef. This is unusual because such prolonged, visible interaction with humans combined with adaptive camouflage is rarely observed in wild octopuses, especially in deep or open-sea environments.</answer>",84 "visual_input": [85 "frames/frame_000000.jpg",86 "frames/frame_000001.jpg",87 "frames/frame_000002.jpg",88 "frames/frame_000003.jpg",89 "frames/frame_000004.jpg",90 "frames/frame_000005.jpg",91 "frames/frame_000006.jpg",92 "frames/frame_000007.jpg",93 "frames/frame_000008.jpg",94 "frames/frame_000009.jpg",95 "frames/frame_000010.jpg",96 "frames/frame_000011.jpg",97 "frames/frame_000012.jpg",98 "frames/frame_000013.jpg",99 "frames/frame_000014.jpg",100 "frames/frame_000015.jpg",101 "frames/frame_000016.jpg",102 "frames/frame_000017.jpg",103 "frames/frame_000018.jpg",104 "frames/frame_000019.jpg",105 "frames/frame_000020.jpg",106 "frames/frame_000021.jpg",107 "frames/frame_000022.jpg",108 "frames/frame_000023.jpg",109 "frames/frame_000024.jpg",110 "frames/frame_000025.jpg",111 "frames/frame_000026.jpg",112 "frames/frame_000027.jpg",113 "frames/frame_000028.jpg",114 "frames/frame_000029.jpg",115 "frames/frame_000030.jpg",116 "frames/frame_000031.jpg",117 "frames/frame_000032.jpg",118 "frames/frame_000033.jpg",119 "frames/frame_000034.jpg",120 "frames/frame_000035.jpg",121 "frames/frame_000036.jpg",122 "frames/frame_000037.jpg",123 "frames/frame_000038.jpg",124 "frames/frame_000039.jpg",125 "frames/frame_000040.jpg",126 "frames/frame_000041.jpg",127 "frames/frame_000042.jpg",128 "frames/frame_000043.jpg",129 "frames/frame_000044.jpg",130 "frames/frame_000045.jpg",131 "frames/frame_000046.jpg",132 "frames/frame_000047.jpg",133 "frames/frame_000048.jpg"134 ]135 }136 ]137 },138 {139 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",140 "answer": "A large hammerhead shark is swimming extremely close to divers, appearing to interact with them in a calm and non-aggressive manner. This is unusual because sharks typically exhibit wariness or avoidance behavior toward humans, making such close, peaceful interaction rare and noteworthy.",141 "dimension": "SemanticReasoning",142 "subdimension": "AbnormalEventSummarization",143 "question_task": "VideoSummarization",144 "question_format": "Open-endQuestion",145 "video_id": "9WQ6zcn27NYZ",146 "video_url": "https://www.instagram.com/nadia.aly.photo/reel/Bc1Xbx2BE-i",147 "video_scene": "000002_000003",148 "id": 103,149 "original_video_id": "Bc1Xbx2BE-i",150 "turns": [151 {152 "id": 103,153 "turn_id": 1,154 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",155 "assistant_response": "<answer>A large hammerhead shark is swimming extremely close to divers, appearing to interact with them in a calm and non-aggressive manner. This is unusual because sharks typically exhibit wariness or avoidance behavior toward humans, making such close, peaceful interaction rare and noteworthy.</answer>",156 "visual_input": [157 "frames/frame_000000.jpg",158 "frames/frame_000001.jpg"159 ]160 }161 ]162 },163 {164 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",165 "answer": "A fish is guarding a cluster of eggs in an exposed, rocky underwater environment. This is unusual because egg guarding behavior in such open and debris-filled locations is atypical for most fish species, which usually nest in sheltered or concealed areas to protect their offspring.",166 "dimension": "SemanticReasoning",167 "subdimension": "AbnormalEventSummarization",168 "question_task": "VideoSummarization",169 "question_format": "Open-endQuestion",170 "video_id": "qKpQrkUVmxkj",171 "video_url": "https://www.youtube.com/watch?v=KztyW1fIE4s",172 "video_scene": "000751_000757",173 "id": 104,174 "original_video_id": "KztyW1fIE4s",175 "turns": [176 {177 "id": 104,178 "turn_id": 1,179 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",180 "assistant_response": "<answer>A fish is guarding a cluster of eggs in an exposed, rocky underwater environment. This is unusual because egg guarding behavior in such open and debris-filled locations is atypical for most fish species, which usually nest in sheltered or concealed areas to protect their offspring.</answer>",181 "visual_input": [182 "frames/frame_000000.jpg",183 "frames/frame_000001.jpg",184 "frames/frame_000002.jpg",185 "frames/frame_000003.jpg",186 "frames/frame_000004.jpg",187 "frames/frame_000005.jpg",188 "frames/frame_000006.jpg"189 ]190 }191 ]192 },193 {194 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",195 "answer": "Seahorses are swimming very close to the diver, clinging to their mask and equipment. This is unusual because seahorses typically avoid human contact and do not normally approach divers so closely, making this interaction atypical in their natural behavior.",196 "dimension": "SemanticReasoning",197 "subdimension": "AbnormalEventSummarization",198 "question_task": "VideoSummarization",199 "question_format": "Open-endQuestion",200 "video_id": "fRuGB8TT66eJ",201 "video_url": "https://www.instagram.com/tomparkfilms/reel/CTGARgchPfL",202 "video_scene": "000000_000027",203 "id": 105,204 "original_video_id": "CTGARgchPfL",205 "turns": [206 {207 "id": 105,208 "turn_id": 1,209 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",210 "assistant_response": "<answer>Seahorses are swimming very close to the diver, clinging to their mask and equipment. This is unusual because seahorses typically avoid human contact and do not normally approach divers so closely, making this interaction atypical in their natural behavior.</answer>",211 "visual_input": [212 "frames/frame_000000.jpg",213 "frames/frame_000001.jpg",214 "frames/frame_000002.jpg",215 "frames/frame_000003.jpg",216 "frames/frame_000004.jpg",217 "frames/frame_000005.jpg",218 "frames/frame_000006.jpg",219 "frames/frame_000007.jpg",220 "frames/frame_000008.jpg",221 "frames/frame_000009.jpg",222 "frames/frame_000010.jpg",223 "frames/frame_000011.jpg",224 "frames/frame_000012.jpg",225 "frames/frame_000013.jpg",226 "frames/frame_000014.jpg",227 "frames/frame_000015.jpg",228 "frames/frame_000016.jpg",229 "frames/frame_000017.jpg",230 "frames/frame_000018.jpg",231 "frames/frame_000019.jpg",232 "frames/frame_000020.jpg",233 "frames/frame_000021.jpg",234 "frames/frame_000022.jpg",235 "frames/frame_000023.jpg",236 "frames/frame_000024.jpg",237 "frames/frame_000025.jpg",238 "frames/frame_000026.jpg",239 "frames/frame_000027.jpg"240 ]241 }242 ]243 },244 {245 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",246 "answer": "A large crab is feeding on a fish, which appears to be partially consumed or carried by the crab \u2014 an unusual predatory behavior for this type of crab, as they typically scavenge or hunt smaller prey. This is rare because crabs of this size are not commonly observed actively preying on fish in their natural habitat.",247 "dimension": "SemanticReasoning",248 "subdimension": "AbnormalEventSummarization",249 "question_task": "VideoSummarization",250 "question_format": "Open-endQuestion",251 "video_id": "V8tTgRLXQaSE",252 "video_url": "https://www.instagram.com/mbari_news/reel/DRVjN4Hkh-O",253 "video_scene": "000000_000015",254 "id": 106,255 "original_video_id": "DRVjN4Hkh-O",256 "turns": [257 {258 "id": 106,259 "turn_id": 1,260 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",261 "assistant_response": "<answer>A large crab is feeding on a fish, which appears to be partially consumed or carried by the crab \u2014 an unusual predatory behavior for this type of crab, as they typically scavenge or hunt smaller prey. This is rare because crabs of this size are not commonly observed actively preying on fish in their natural habitat.</answer>",262 "visual_input": [263 "frames/frame_000000.jpg",264 "frames/frame_000001.jpg",265 "frames/frame_000002.jpg",266 "frames/frame_000003.jpg",267 "frames/frame_000004.jpg",268 "frames/frame_000005.jpg",269 "frames/frame_000006.jpg",270 "frames/frame_000007.jpg",271 "frames/frame_000008.jpg",272 "frames/frame_000009.jpg",273 "frames/frame_000010.jpg",274 "frames/frame_000011.jpg",275 "frames/frame_000012.jpg",276 "frames/frame_000013.jpg",277 "frames/frame_000014.jpg",278 "frames/frame_000015.jpg"279 ]280 }281 ]282 },283 {284 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",285 "answer": "A scuba diver is in extremely close proximity to a large shark, with the shark appearing calm and interacting directly by touching or sniffing the diver's hand, which is unusual given sharks' typical behavior around humans.",286 "dimension": "SemanticReasoning",287 "subdimension": "AbnormalEventSummarization",288 "question_task": "VideoSummarization",289 "question_format": "Open-endQuestion",290 "video_id": "oZNbSANSOCcz",291 "video_url": "https://www.youtube.com/watch?v=cKQeIXSLcYU",292 "video_scene": "000014_000015",293 "id": 107,294 "original_video_id": "cKQeIXSLcYU",295 "turns": [296 {297 "id": 107,298 "turn_id": 1,299 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",300 "assistant_response": "<answer>A scuba diver is in extremely close proximity to a large shark, with the shark appearing calm and interacting directly by touching or sniffing the diver's hand, which is unusual given sharks' typical behavior around humans.</answer>",301 "visual_input": [302 "frames/frame_000000.jpg",303 "frames/frame_000001.jpg"304 ]305 }306 ]307 },308 {309 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",310 "answer": "A scuba diver gently touches the head and face of a tiger shark while it remains calm and unaggressive. This is unusual because tiger sharks are typically wary of humans, and such direct physical contact is rare and potentially hazardous.",311 "dimension": "SemanticReasoning",312 "subdimension": "AbnormalEventSummarization",313 "question_task": "VideoSummarization",314 "question_format": "Open-endQuestion",315 "video_id": "0ySdjEhBkHId",316 "video_url": "https://www.instagram.com/tomparkfilms/reel/BlZBQlVnkHg",317 "video_scene": "000000_000010",318 "id": 108,319 "original_video_id": "BlZBQlVnkHg",320 "turns": [321 {322 "id": 108,323 "turn_id": 1,324 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",325 "assistant_response": "<answer>A scuba diver gently touches the head and face of a tiger shark while it remains calm and unaggressive. This is unusual because tiger sharks are typically wary of humans, and such direct physical contact is rare and potentially hazardous.</answer>",326 "visual_input": [327 "frames/frame_000000.jpg",328 "frames/frame_000001.jpg",329 "frames/frame_000002.jpg",330 "frames/frame_000003.jpg",331 "frames/frame_000004.jpg",332 "frames/frame_000005.jpg",333 "frames/frame_000006.jpg",334 "frames/frame_000007.jpg",335 "frames/frame_000008.jpg",336 "frames/frame_000009.jpg",337 "frames/frame_000010.jpg"338 ]339 }340 ]341 },342 {343 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",344 "answer": "A human is measuring the claw of a crab with calipers. This is unusual because such detailed scientific measurement of a marine crustacean is rarely performed in natural field settings without controlled conditions, indicating an active marine research or conservation activity.",345 "dimension": "SemanticReasoning",346 "subdimension": "AbnormalEventSummarization",347 "question_task": "VideoSummarization",348 "question_format": "Open-endQuestion",349 "video_id": "woizjxR1tT01",350 "video_url": "https://www.youtube.com/watch?v=ruzpOuzqlW4",351 "video_scene": "000462_000464",352 "id": 109,353 "original_video_id": "ruzpOuzqlW4",354 "turns": [355 {356 "id": 109,357 "turn_id": 1,358 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",359 "assistant_response": "<answer>A human is measuring the claw of a crab with calipers. This is unusual because such detailed scientific measurement of a marine crustacean is rarely performed in natural field settings without controlled conditions, indicating an active marine research or conservation activity.</answer>",360 "visual_input": [361 "frames/frame_000000.jpg",362 "frames/frame_000001.jpg",363 "frames/frame_000002.jpg"364 ]365 }366 ]367 },368 {369 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",370 "answer": "A diver discovers and carefully removes a baited hook and trailing line from a stingray. This is unusual because such human intervention to rescue marine animals from fishing gear is both rare to witness and demonstrates direct conservation effort in a natural underwater setting.",371 "dimension": "SemanticReasoning",372 "subdimension": "AbnormalEventSummarization",373 "question_task": "VideoSummarization",374 "question_format": "Open-endQuestion",375 "video_id": "1guDuhhckvFP",376 "video_url": "https://www.instagram.com/onebreathdiver/reel/DCarxOkPeB4",377 "video_scene": "000003_000053",378 "id": 110,379 "original_video_id": "DCarxOkPeB4",380 "turns": [381 {382 "id": 110,383 "turn_id": 1,384 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",385 "assistant_response": "<answer>A diver discovers and carefully removes a baited hook and trailing line from a stingray. This is unusual because such human intervention to rescue marine animals from fishing gear is both rare to witness and demonstrates direct conservation effort in a natural underwater setting.</answer>",386 "visual_input": [387 "frames/frame_000000.jpg",388 "frames/frame_000001.jpg",389 "frames/frame_000002.jpg",390 "frames/frame_000003.jpg",391 "frames/frame_000004.jpg",392 "frames/frame_000005.jpg",393 "frames/frame_000006.jpg",394 "frames/frame_000007.jpg",395 "frames/frame_000008.jpg",396 "frames/frame_000009.jpg",397 "frames/frame_000010.jpg",398 "frames/frame_000011.jpg",399 "frames/frame_000012.jpg",400 "frames/frame_000013.jpg",401 "frames/frame_000014.jpg",402 "frames/frame_000015.jpg",403 "frames/frame_000016.jpg",404 "frames/frame_000017.jpg",405 "frames/frame_000018.jpg",406 "frames/frame_000019.jpg",407 "frames/frame_000020.jpg",408 "frames/frame_000021.jpg",409 "frames/frame_000022.jpg",410 "frames/frame_000023.jpg",411 "frames/frame_000024.jpg",412 "frames/frame_000025.jpg",413 "frames/frame_000026.jpg",414 "frames/frame_000027.jpg",415 "frames/frame_000028.jpg",416 "frames/frame_000029.jpg",417 "frames/frame_000030.jpg",418 "frames/frame_000031.jpg",419 "frames/frame_000032.jpg",420 "frames/frame_000033.jpg",421 "frames/frame_000034.jpg",422 "frames/frame_000035.jpg",423 "frames/frame_000036.jpg",424 "frames/frame_000037.jpg",425 "frames/frame_000038.jpg",426 "frames/frame_000039.jpg",427 "frames/frame_000040.jpg",428 "frames/frame_000041.jpg",429 "frames/frame_000042.jpg",430 "frames/frame_000043.jpg",431 "frames/frame_000044.jpg",432 "frames/frame_000045.jpg",433 "frames/frame_000046.jpg",434 "frames/frame_000047.jpg",435 "frames/frame_000048.jpg",436 "frames/frame_000049.jpg",437 "frames/frame_000050.jpg"438 ]439 }440 ]441 },442 {443 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",444 "answer": "A diver approaches and interacts closely with a large, unusual-looking marine creature (possibly a warty frogfish) resting on the seafloor, without provoking any reaction from the animal. This is unusual because such calm, non-reactive behavior from a cryptic deep-sea predator during close human proximity is rarely observed in natural underwater settings.",445 "dimension": "SemanticReasoning",446 "subdimension": "AbnormalEventSummarization",447 "question_task": "VideoSummarization",448 "question_format": "Open-endQuestion",449 "video_id": "GKTIHoswFsBi",450 "video_url": "https://www.instagram.com/ocean_reality/reel/CxKT2ycJTtR",451 "video_scene": "000000_000027",452 "id": 111,453 "original_video_id": "CxKT2ycJTtR",454 "turns": [455 {456 "id": 111,457 "turn_id": 1,458 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",459 "assistant_response": "<answer>A diver approaches and interacts closely with a large, unusual-looking marine creature (possibly a warty frogfish) resting on the seafloor, without provoking any reaction from the animal. This is unusual because such calm, non-reactive behavior from a cryptic deep-sea predator during close human proximity is rarely observed in natural underwater settings.</answer>",460 "visual_input": [461 "frames/frame_000000.jpg",462 "frames/frame_000001.jpg",463 "frames/frame_000002.jpg",464 "frames/frame_000003.jpg",465 "frames/frame_000004.jpg",466 "frames/frame_000005.jpg",467 "frames/frame_000006.jpg",468 "frames/frame_000007.jpg",469 "frames/frame_000008.jpg",470 "frames/frame_000009.jpg",471 "frames/frame_000010.jpg",472 "frames/frame_000011.jpg",473 "frames/frame_000012.jpg",474 "frames/frame_000013.jpg",475 "frames/frame_000014.jpg",476 "frames/frame_000015.jpg",477 "frames/frame_000016.jpg",478 "frames/frame_000017.jpg",479 "frames/frame_000018.jpg",480 "frames/frame_000019.jpg",481 "frames/frame_000020.jpg",482 "frames/frame_000021.jpg",483 "frames/frame_000022.jpg",484 "frames/frame_000023.jpg",485 "frames/frame_000024.jpg",486 "frames/frame_000025.jpg",487 "frames/frame_000026.jpg",488 "frames/frame_000027.jpg"489 ]490 }491 ]492 },493 {494 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",495 "answer": "A scuba diver swims very close to a whale shark with its mouth open, surrounded by numerous fish. This is unusual because whale sharks are typically solitary and shy, making such calm, close human interaction extremely rare and remarkable.",496 "dimension": "SemanticReasoning",497 "subdimension": "AbnormalEventSummarization",498 "question_task": "VideoSummarization",499 "question_format": "Open-endQuestion",500 "video_id": "EhKgwnaTmY9A",501 "video_url": "https://www.instagram.com/ocean_reality/reel/CrgkAmDpGsw",502 "video_scene": "000000_000013",503 "id": 112,504 "original_video_id": "CrgkAmDpGsw",505 "turns": [506 {507 "id": 112,508 "turn_id": 1,509 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",510 "assistant_response": "<answer>A scuba diver swims very close to a whale shark with its mouth open, surrounded by numerous fish. This is unusual because whale sharks are typically solitary and shy, making such calm, close human interaction extremely rare and remarkable.</answer>",511 "visual_input": [512 "frames/frame_000000.jpg",513 "frames/frame_000001.jpg",514 "frames/frame_000002.jpg",515 "frames/frame_000003.jpg",516 "frames/frame_000004.jpg",517 "frames/frame_000005.jpg",518 "frames/frame_000006.jpg",519 "frames/frame_000007.jpg",520 "frames/frame_000008.jpg",521 "frames/frame_000009.jpg",522 "frames/frame_000010.jpg",523 "frames/frame_000011.jpg",524 "frames/frame_000012.jpg",525 "frames/frame_000013.jpg"526 ]527 }528 ]529 },530 {531 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",532 "answer": "A human hand is holding a Red Bull can underwater. This is unusual because it represents deliberate littering of non-biodegradable waste in a marine environment, which poses a direct threat to marine life and ecosystem health.",533 "dimension": "SemanticReasoning",534 "subdimension": "AbnormalEventSummarization",535 "question_task": "VideoSummarization",536 "question_format": "Open-endQuestion",537 "video_id": "3cWTYDmGHH49",538 "video_url": "https://www.instagram.com/onebreathdiver/reel/CIRHtS4hW9N",539 "video_scene": "000018_000019",540 "id": 113,541 "original_video_id": "CIRHtS4hW9N",542 "turns": [543 {544 "id": 113,545 "turn_id": 1,546 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",547 "assistant_response": "<answer>A human hand is holding a Red Bull can underwater. This is unusual because it represents deliberate littering of non-biodegradable waste in a marine environment, which poses a direct threat to marine life and ecosystem health.</answer>",548 "visual_input": [549 "frames/frame_000000.jpg",550 "frames/frame_000001.jpg"551 ]552 }553 ]554 },555 {556 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",557 "answer": "Two seahorses are engaged in a synchronized mating ritual, intertwining their tails and bodies in a heart-shaped formation. This is unusual because such visually striking, coordinated courtship behavior\u2014often interpreted as a romantic display\u2014is rarely observed with such clarity in the wild and is considered a unique marine behavioral spectacle.",558 "dimension": "SemanticReasoning",559 "subdimension": "AbnormalEventSummarization",560 "question_task": "VideoSummarization",561 "question_format": "Open-endQuestion",562 "video_id": "izLdm5htUR6M",563 "video_url": "https://www.instagram.com/onebreathdiver/reel/B_s7Hp_BqK5",564 "video_scene": "000000_000017",565 "id": 114,566 "original_video_id": "B_s7Hp_BqK5",567 "turns": [568 {569 "id": 114,570 "turn_id": 1,571 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",572 "assistant_response": "<answer>Two seahorses are engaged in a synchronized mating ritual, intertwining their tails and bodies in a heart-shaped formation. This is unusual because such visually striking, coordinated courtship behavior\u2014often interpreted as a romantic display\u2014is rarely observed with such clarity in the wild and is considered a unique marine behavioral spectacle.</answer>",573 "visual_input": [574 "frames/frame_000000.jpg",575 "frames/frame_000001.jpg",576 "frames/frame_000002.jpg",577 "frames/frame_000003.jpg",578 "frames/frame_000004.jpg",579 "frames/frame_000005.jpg",580 "frames/frame_000006.jpg",581 "frames/frame_000007.jpg",582 "frames/frame_000008.jpg",583 "frames/frame_000009.jpg",584 "frames/frame_000010.jpg",585 "frames/frame_000011.jpg",586 "frames/frame_000012.jpg",587 "frames/frame_000013.jpg",588 "frames/frame_000014.jpg",589 "frames/frame_000015.jpg",590 "frames/frame_000016.jpg",591 "frames/frame_000017.jpg"592 ]593 }594 ]595 },596 {597 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",598 "answer": "A squid emits a bright bioluminescent flash in response to the camera\u2019s light. This is unusual because bioluminescent displays for defense or communication are rarely observed in real-time underwater footage, especially under direct artificial illumination.",599 "dimension": "SemanticReasoning",600 "subdimension": "AbnormalEventSummarization",601 "question_task": "VideoSummarization",602 "question_format": "Open-endQuestion",603 "video_id": "YdxYVREuV709",604 "video_url": "https://www.instagram.com/tomparkfilms/reel/BbvBLypl68P",605 "video_scene": "000000_000011",606 "id": 115,607 "original_video_id": "BbvBLypl68P",608 "turns": [609 {610 "id": 115,611 "turn_id": 1,612 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",613 "assistant_response": "<answer>A squid emits a bright bioluminescent flash in response to the camera\u2019s light. This is unusual because bioluminescent displays for defense or communication are rarely observed in real-time underwater footage, especially under direct artificial illumination.</answer>",614 "visual_input": [615 "frames/frame_000000.jpg",616 "frames/frame_000001.jpg",617 "frames/frame_000002.jpg",618 "frames/frame_000003.jpg",619 "frames/frame_000004.jpg",620 "frames/frame_000005.jpg",621 "frames/frame_000006.jpg",622 "frames/frame_000007.jpg",623 "frames/frame_000008.jpg",624 "frames/frame_000009.jpg",625 "frames/frame_000010.jpg",626 "frames/frame_000011.jpg"627 ]628 }629 ]630 },631 {632 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",633 "answer": "A scuba diver is kneeling on the ocean floor and calmly touching the snout of a large tiger shark, which approaches without aggression. This is unusual because tiger sharks are apex predators typically perceived as dangerous, and close, non-aggressive interaction with humans is extremely rare and unexpected in natural marine environments.",634 "dimension": "SemanticReasoning",635 "subdimension": "AbnormalEventSummarization",636 "question_task": "VideoSummarization",637 "question_format": "Open-endQuestion",638 "video_id": "CpvMjBD8HaLP",639 "video_url": "https://www.instagram.com/rodrigofriscione/reel/wBz1f6SmBC",640 "video_scene": "000000_000014",641 "id": 116,642 "original_video_id": "wBz1f6SmBC",643 "turns": [644 {645 "id": 116,646 "turn_id": 1,647 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",648 "assistant_response": "<answer>A scuba diver is kneeling on the ocean floor and calmly touching the snout of a large tiger shark, which approaches without aggression. This is unusual because tiger sharks are apex predators typically perceived as dangerous, and close, non-aggressive interaction with humans is extremely rare and unexpected in natural marine environments.</answer>",649 "visual_input": [650 "frames/frame_000000.jpg",651 "frames/frame_000001.jpg",652 "frames/frame_000002.jpg",653 "frames/frame_000003.jpg",654 "frames/frame_000004.jpg",655 "frames/frame_000005.jpg",656 "frames/frame_000006.jpg",657 "frames/frame_000007.jpg",658 "frames/frame_000008.jpg",659 "frames/frame_000009.jpg",660 "frames/frame_000010.jpg",661 "frames/frame_000011.jpg",662 "frames/frame_000012.jpg",663 "frames/frame_000013.jpg",664 "frames/frame_000014.jpg"665 ]666 }667 ]668 },669 {670 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",671 "answer": "A gloved human hand picks up a submerged smartphone from the ocean floor amidst mussel shells. This is unusual because it indicates human interference with marine environments, possibly involving improper disposal of electronic waste or reckless behavior near underwater ecosystems.",672 "dimension": "SemanticReasoning",673 "subdimension": "AbnormalEventSummarization",674 "question_task": "VideoSummarization",675 "question_format": "Open-endQuestion",676 "video_id": "5xdB0KucuugI",677 "video_url": "https://www.instagram.com/onebreathdiver/reel/DKYSFPfyKov",678 "video_scene": "000000_000004",679 "id": 117,680 "original_video_id": "DKYSFPfyKov",681 "turns": [682 {683 "id": 117,684 "turn_id": 1,685 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",686 "assistant_response": "<answer>A gloved human hand picks up a submerged smartphone from the ocean floor amidst mussel shells. This is unusual because it indicates human interference with marine environments, possibly involving improper disposal of electronic waste or reckless behavior near underwater ecosystems.</answer>",687 "visual_input": [688 "frames/frame_000000.jpg",689 "frames/frame_000001.jpg",690 "frames/frame_000002.jpg",691 "frames/frame_000003.jpg",692 "frames/frame_000004.jpg"693 ]694 }695 ]696 },697 {698 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",699 "answer": "A scuba diver swims very close to a whale shark while holding a camera rig. This is unusual because whale sharks typically avoid close human interaction, making such a calm and proximate encounter rare and exceptional.",700 "dimension": "SemanticReasoning",701 "subdimension": "AbnormalEventSummarization",702 "question_task": "VideoSummarization",703 "question_format": "Open-endQuestion",704 "video_id": "B9M1330xRG9N",705 "video_url": "https://www.instagram.com/ocean_reality/reel/CslXxc1JOtX",706 "video_scene": "000000_000006",707 "id": 118,708 "original_video_id": "CslXxc1JOtX",709 "turns": [710 {711 "id": 118,712 "turn_id": 1,713 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",714 "assistant_response": "<answer>A scuba diver swims very close to a whale shark while holding a camera rig. This is unusual because whale sharks typically avoid close human interaction, making such a calm and proximate encounter rare and exceptional.</answer>",715 "visual_input": [716 "frames/frame_000000.jpg",717 "frames/frame_000001.jpg",718 "frames/frame_000002.jpg",719 "frames/frame_000003.jpg",720 "frames/frame_000004.jpg",721 "frames/frame_000005.jpg",722 "frames/frame_000006.jpg"723 ]724 }725 ]726 },727 {728 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",729 "answer": "The octopus is using a white shell as a protective shelter by wrapping its arms around it. This is unusual because while octopuses are known to use objects for camouflage or defense, the deliberate and precise use of a specific shell in this manner\u2014especially underwater where such behavior is rarely observed\u2014is uncommon and highlights advanced tool-use behavior in cephalopods.",730 "dimension": "SemanticReasoning",731 "subdimension": "AbnormalEventSummarization",732 "question_task": "VideoSummarization",733 "question_format": "Open-endQuestion",734 "video_id": "Zc7SklboN9QT",735 "video_url": "https://www.instagram.com/onebreathdiver/reel/CUcaAtHIkLT",736 "video_scene": "000162_000171",737 "id": 119,738 "original_video_id": "CUcaAtHIkLT",739 "turns": [740 {741 "id": 119,742 "turn_id": 1,743 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",744 "assistant_response": "<answer>The octopus is using a white shell as a protective shelter by wrapping its arms around it. This is unusual because while octopuses are known to use objects for camouflage or defense, the deliberate and precise use of a specific shell in this manner\u2014especially underwater where such behavior is rarely observed\u2014is uncommon and highlights advanced tool-use behavior in cephalopods.</answer>",745 "visual_input": [746 "frames/frame_000000.jpg",747 "frames/frame_000001.jpg",748 "frames/frame_000002.jpg",749 "frames/frame_000003.jpg",750 "frames/frame_000004.jpg",751 "frames/frame_000005.jpg",752 "frames/frame_000006.jpg",753 "frames/frame_000007.jpg",754 "frames/frame_000008.jpg",755 "frames/frame_000009.jpg"756 ]757 }758 ]759 },760 {761 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",762 "answer": "A squid is releasing a cloud of dark ink into the water as a defense mechanism. This is unusual because the clarity and timing of the ink release are rarely captured in underwater footage, especially with such distinct visual dispersion against the reef backdrop.",763 "dimension": "SemanticReasoning",764 "subdimension": "AbnormalEventSummarization",765 "question_task": "VideoSummarization",766 "question_format": "Open-endQuestion",767 "video_id": "4z9PbcnThJZa",768 "video_url": "https://www.youtube.com/watch?v=qfGT78-sIzk",769 "video_scene": "000371_000381",770 "id": 120,771 "original_video_id": "qfGT78-sIzk",772 "turns": [773 {774 "id": 120,775 "turn_id": 1,776 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",777 "assistant_response": "<answer>A squid is releasing a cloud of dark ink into the water as a defense mechanism. This is unusual because the clarity and timing of the ink release are rarely captured in underwater footage, especially with such distinct visual dispersion against the reef backdrop.</answer>",778 "visual_input": [779 "frames/frame_000000.jpg",780 "frames/frame_000001.jpg",781 "frames/frame_000002.jpg",782 "frames/frame_000003.jpg",783 "frames/frame_000004.jpg",784 "frames/frame_000005.jpg",785 "frames/frame_000006.jpg",786 "frames/frame_000007.jpg",787 "frames/frame_000008.jpg",788 "frames/frame_000009.jpg",789 "frames/frame_000010.jpg"790 ]791 }792 ]793 },794 {795 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",796 "answer": "An octopus is using a discarded can as shelter, showcasing its ability to repurpose human-made objects \u2014 an example of tool use in cephalopods. This is unusual because such behavior demonstrates advanced problem-solving and adaptation to anthropogenic debris, which is rarely documented in wild marine environments.",797 "dimension": "SemanticReasoning",798 "subdimension": "AbnormalEventSummarization",799 "question_task": "VideoSummarization",800 "question_format": "Open-endQuestion",801 "video_id": "bBiRfkHQe0lu",802 "video_url": "https://www.instagram.com/onebreathdiver/reel/DGwjUyKS8Rk",803 "video_scene": "000007_000007",804 "id": 121,805 "original_video_id": "DGwjUyKS8Rk",806 "turns": [807 {808 "id": 121,809 "turn_id": 1,810 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",811 "assistant_response": "<answer>An octopus is using a discarded can as shelter, showcasing its ability to repurpose human-made objects \u2014 an example of tool use in cephalopods. This is unusual because such behavior demonstrates advanced problem-solving and adaptation to anthropogenic debris, which is rarely documented in wild marine environments.</answer>",812 "visual_input": [813 "frames/frame_000000.jpg"814 ]815 }816 ]817 },818 {819 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",820 "answer": "A pod of humpback whales is performing bubble net feeding. This is unusual because it involves highly coordinated behavior where multiple whales create a curtain of bubbles to corral prey, a complex social hunting strategy that is not commonly observed in all whale populations.",821 "dimension": "SemanticReasoning",822 "subdimension": "AbnormalEventSummarization",823 "question_task": "VideoSummarization",824 "question_format": "Open-endQuestion",825 "video_id": "Sbnb0riYo1vt",826 "video_url": "https://www.instagram.com/nadia.aly.photo/reel/CYgfy8IlYrJ",827 "video_scene": "000198_000201",828 "id": 122,829 "original_video_id": "CYgfy8IlYrJ",830 "turns": [831 {832 "id": 122,833 "turn_id": 1,834 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",835 "assistant_response": "<answer>A pod of humpback whales is performing bubble net feeding. This is unusual because it involves highly coordinated behavior where multiple whales create a curtain of bubbles to corral prey, a complex social hunting strategy that is not commonly observed in all whale populations.</answer>",836 "visual_input": [837 "frames/frame_000000.jpg",838 "frames/frame_000001.jpg",839 "frames/frame_000002.jpg",840 "frames/frame_000003.jpg"841 ]842 }843 ]844 },845 {846 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",847 "answer": "An orange squid is capturing and consuming a fish, which is unusual as squids typically feed on smaller prey like crustaceans or other cephalopods; this indicates an opportunistic feeding behavior on a relatively larger fish.",848 "dimension": "SemanticReasoning",849 "subdimension": "AbnormalEventSummarization",850 "question_task": "VideoSummarization",851 "question_format": "Open-endQuestion",852 "video_id": "v3yXSt7v86kI",853 "video_url": "https://www.instagram.com/mbari_news/reel/CuFFpRHNwFL",854 "video_scene": "000000_000019",855 "id": 123,856 "original_video_id": "CuFFpRHNwFL",857 "turns": [858 {859 "id": 123,860 "turn_id": 1,861 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",862 "assistant_response": "<answer>An orange squid is capturing and consuming a fish, which is unusual as squids typically feed on smaller prey like crustaceans or other cephalopods; this indicates an opportunistic feeding behavior on a relatively larger fish.</answer>",863 "visual_input": [864 "frames/frame_000000.jpg",865 "frames/frame_000001.jpg",866 "frames/frame_000002.jpg",867 "frames/frame_000003.jpg",868 "frames/frame_000004.jpg",869 "frames/frame_000005.jpg",870 "frames/frame_000006.jpg",871 "frames/frame_000007.jpg",872 "frames/frame_000008.jpg",873 "frames/frame_000009.jpg",874 "frames/frame_000010.jpg",875 "frames/frame_000011.jpg",876 "frames/frame_000012.jpg",877 "frames/frame_000013.jpg",878 "frames/frame_000014.jpg",879 "frames/frame_000015.jpg",880 "frames/frame_000016.jpg",881 "frames/frame_000017.jpg",882 "frames/frame_000018.jpg",883 "frames/frame_000019.jpg"884 ]885 }886 ]887 },888 {889 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",890 "answer": "The Leopard Flounder instantly changes its color and pattern to match the seafloor using chromatophores, effectively camouflaging itself. This is unusual because such rapid and precise camouflage occurs in real time and is rarely observed with such clarity in natural underwater settings.",891 "dimension": "SemanticReasoning",892 "subdimension": "AbnormalEventSummarization",893 "question_task": "VideoSummarization",894 "question_format": "Open-endQuestion",895 "video_id": "y7cMxpdMZoeh",896 "video_url": "https://www.instagram.com/big.blue.sea/reel/DQt0vHaDLjd",897 "video_scene": "000000_000024",898 "id": 124,899 "original_video_id": "DQt0vHaDLjd",900 "turns": [901 {902 "id": 124,903 "turn_id": 1,904 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",905 "assistant_response": "<answer>The Leopard Flounder instantly changes its color and pattern to match the seafloor using chromatophores, effectively camouflaging itself. This is unusual because such rapid and precise camouflage occurs in real time and is rarely observed with such clarity in natural underwater settings.</answer>",906 "visual_input": [907 "frames/frame_000000.jpg",908 "frames/frame_000001.jpg",909 "frames/frame_000002.jpg",910 "frames/frame_000003.jpg",911 "frames/frame_000004.jpg",912 "frames/frame_000005.jpg",913 "frames/frame_000006.jpg",914 "frames/frame_000007.jpg",915 "frames/frame_000008.jpg",916 "frames/frame_000009.jpg",917 "frames/frame_000010.jpg",918 "frames/frame_000011.jpg",919 "frames/frame_000012.jpg",920 "frames/frame_000013.jpg",921 "frames/frame_000014.jpg",922 "frames/frame_000015.jpg",923 "frames/frame_000016.jpg",924 "frames/frame_000017.jpg",925 "frames/frame_000018.jpg",926 "frames/frame_000019.jpg",927 "frames/frame_000020.jpg",928 "frames/frame_000021.jpg",929 "frames/frame_000022.jpg",930 "frames/frame_000023.jpg",931 "frames/frame_000024.jpg"932 ]933 }934 ]935 },936 {937 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",938 "answer": "A group of banded sea snakes emerges from the sandy seabed and swims into open water. This is unusual because such coordinated emergence and collective movement of multiple sea snakes are rarely observed, especially in dark, low-visibility conditions, suggesting possible mating or spawning behavior.",939 "dimension": "SemanticReasoning",940 "subdimension": "AbnormalEventSummarization",941 "question_task": "VideoSummarization",942 "question_format": "Open-endQuestion",943 "video_id": "TcauwdyQRZSx",944 "video_url": "https://www.instagram.com/diveivanov/reel/C_qIYn-h-ZD",945 "video_scene": "000000_000016",946 "id": 125,947 "original_video_id": "C_qIYn-h-ZD",948 "turns": [949 {950 "id": 125,951 "turn_id": 1,952 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",953 "assistant_response": "<answer>A group of banded sea snakes emerges from the sandy seabed and swims into open water. This is unusual because such coordinated emergence and collective movement of multiple sea snakes are rarely observed, especially in dark, low-visibility conditions, suggesting possible mating or spawning behavior.</answer>",954 "visual_input": [955 "frames/frame_000000.jpg",956 "frames/frame_000001.jpg",957 "frames/frame_000002.jpg",958 "frames/frame_000003.jpg",959 "frames/frame_000004.jpg",960 "frames/frame_000005.jpg",961 "frames/frame_000006.jpg",962 "frames/frame_000007.jpg",963 "frames/frame_000008.jpg",964 "frames/frame_000009.jpg",965 "frames/frame_000010.jpg",966 "frames/frame_000011.jpg",967 "frames/frame_000012.jpg",968 "frames/frame_000013.jpg",969 "frames/frame_000014.jpg",970 "frames/frame_000015.jpg",971 "frames/frame_000016.jpg"972 ]973 }974 ]975 },976 {977 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",978 "answer": "A Peacock Mantis Shrimp is guarding its eggs in an exposed location at 10m depth. This is unusual because mantis shrimps typically hide their eggs in sheltered crevices, and observing this behavior in an open, shallow reef environment is uncommon due to increased predation risk.",979 "dimension": "SemanticReasoning",980 "subdimension": "AbnormalEventSummarization",981 "question_task": "VideoSummarization",982 "question_format": "Open-endQuestion",983 "video_id": "aLwgPcyts9lc",984 "video_url": "https://www.instagram.com/diveivanov/reel/DBMA-jDyN4r",985 "video_scene": "000000_000007",986 "id": 126,987 "original_video_id": "DBMA-jDyN4r",988 "turns": [989 {990 "id": 126,991 "turn_id": 1,992 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",993 "assistant_response": "<answer>A Peacock Mantis Shrimp is guarding its eggs in an exposed location at 10m depth. This is unusual because mantis shrimps typically hide their eggs in sheltered crevices, and observing this behavior in an open, shallow reef environment is uncommon due to increased predation risk.</answer>",994 "visual_input": [995 "frames/frame_000000.jpg",996 "frames/frame_000001.jpg",997 "frames/frame_000002.jpg",998 "frames/frame_000003.jpg",999 "frames/frame_000004.jpg",1000 "frames/frame_000005.jpg",1001 "frames/frame_000006.jpg",1002 "frames/frame_000007.jpg"1003 ]1004 }1005 ]1006 },1007 {1008 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1009 "answer": "A small fish is resting on the diver's mask and later swims onto the diver\u2019s gloved hand. This is unusual because wild fish typically avoid close contact with humans, especially in underwater environments where they usually exhibit wariness or flee upon encountering divers.",1010 "dimension": "SemanticReasoning",1011 "subdimension": "AbnormalEventSummarization",1012 "question_task": "VideoSummarization",1013 "question_format": "Open-endQuestion",1014 "video_id": "bu3GzKLBEH89",1015 "video_url": "https://www.instagram.com/onebreathdiver/reel/DE62V51Ph2V",1016 "video_scene": "000000_000004",1017 "id": 127,1018 "original_video_id": "DE62V51Ph2V",1019 "turns": [1020 {1021 "id": 127,1022 "turn_id": 1,1023 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1024 "assistant_response": "<answer>A small fish is resting on the diver's mask and later swims onto the diver\u2019s gloved hand. This is unusual because wild fish typically avoid close contact with humans, especially in underwater environments where they usually exhibit wariness or flee upon encountering divers.</answer>",1025 "visual_input": [1026 "frames/frame_000000.jpg",1027 "frames/frame_000001.jpg",1028 "frames/frame_000002.jpg",1029 "frames/frame_000003.jpg",1030 "frames/frame_000004.jpg"1031 ]1032 }1033 ]1034 },1035 {1036 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1037 "answer": "A sea turtle is ingesting a plastic bag, mistaking it for food. This is unusual because plastic debris is not part of a sea turtle\u2019s natural diet and ingestion poses serious health risks, highlighting the impact of marine pollution on wildlife.",1038 "dimension": "SemanticReasoning",1039 "subdimension": "AbnormalEventSummarization",1040 "question_task": "VideoSummarization",1041 "question_format": "Open-endQuestion",1042 "video_id": "9wJ2Ppu2ZRfE",1043 "video_url": "https://www.instagram.com/romanhurghada/reel/DKMxcn3qp_2",1044 "video_scene": "000000_000008",1045 "id": 128,1046 "original_video_id": "DKMxcn3qp_2",1047 "turns": [1048 {1049 "id": 128,1050 "turn_id": 1,1051 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1052 "assistant_response": "<answer>A sea turtle is ingesting a plastic bag, mistaking it for food. This is unusual because plastic debris is not part of a sea turtle\u2019s natural diet and ingestion poses serious health risks, highlighting the impact of marine pollution on wildlife.</answer>",1053 "visual_input": [1054 "frames/frame_000000.jpg",1055 "frames/frame_000001.jpg",1056 "frames/frame_000002.jpg",1057 "frames/frame_000003.jpg",1058 "frames/frame_000004.jpg",1059 "frames/frame_000005.jpg",1060 "frames/frame_000006.jpg",1061 "frames/frame_000007.jpg",1062 "frames/frame_000008.jpg"1063 ]1064 }1065 ]1066 },1067 {1068 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1069 "answer": "A female Harlequin Snake Eel lays between two and ten million eggs in the water column, which are then fertilized by multiple males during a night dive. This is unusual because mass spawning events of this scale and species are rarely observed directly in the wild due to the deep, dark, and inaccessible marine environments where they occur.",1070 "dimension": "SemanticReasoning",1071 "subdimension": "AbnormalEventSummarization",1072 "question_task": "VideoSummarization",1073 "question_format": "Open-endQuestion",1074 "video_id": "XH44mfWo5wJc",1075 "video_url": "https://www.instagram.com/diveivanov/reel/CzlxUxsx1uY",1076 "video_scene": "000000_000020",1077 "id": 129,1078 "original_video_id": "CzlxUxsx1uY",1079 "turns": [1080 {1081 "id": 129,1082 "turn_id": 1,1083 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1084 "assistant_response": "<answer>A female Harlequin Snake Eel lays between two and ten million eggs in the water column, which are then fertilized by multiple males during a night dive. This is unusual because mass spawning events of this scale and species are rarely observed directly in the wild due to the deep, dark, and inaccessible marine environments where they occur.</answer>",1085 "visual_input": [1086 "frames/frame_000000.jpg",1087 "frames/frame_000001.jpg",1088 "frames/frame_000002.jpg",1089 "frames/frame_000003.jpg",1090 "frames/frame_000004.jpg",1091 "frames/frame_000005.jpg",1092 "frames/frame_000006.jpg",1093 "frames/frame_000007.jpg",1094 "frames/frame_000008.jpg",1095 "frames/frame_000009.jpg",1096 "frames/frame_000010.jpg",1097 "frames/frame_000011.jpg",1098 "frames/frame_000012.jpg",1099 "frames/frame_000013.jpg",1100 "frames/frame_000014.jpg",1101 "frames/frame_000015.jpg",1102 "frames/frame_000016.jpg",1103 "frames/frame_000017.jpg",1104 "frames/frame_000018.jpg",1105 "frames/frame_000019.jpg",1106 "frames/frame_000020.jpg"1107 ]1108 }1109 ]1110 },1111 {1112 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1113 "answer": "A group of humpback whales is cooperatively feeding by creating bubbles to corral fish \u2014 a rare and coordinated hunting behavior known as bubble-net feeding. This is unusual because such synchronized, large-scale cooperative hunting requires complex social coordination and is rarely observed in its full dynamic form from an aerial perspective.",1114 "dimension": "SemanticReasoning",1115 "subdimension": "AbnormalEventSummarization",1116 "question_task": "VideoSummarization",1117 "question_format": "Open-endQuestion",1118 "video_id": "ClnFmlmLBK5J",1119 "video_url": "https://www.instagram.com/nadia.aly.photo/reel/CSHPgFyNfem",1120 "video_scene": "000000_000025",1121 "id": 130,1122 "original_video_id": "CSHPgFyNfem",1123 "turns": [1124 {1125 "id": 130,1126 "turn_id": 1,1127 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1128 "assistant_response": "<answer>A group of humpback whales is cooperatively feeding by creating bubbles to corral fish \u2014 a rare and coordinated hunting behavior known as bubble-net feeding. This is unusual because such synchronized, large-scale cooperative hunting requires complex social coordination and is rarely observed in its full dynamic form from an aerial perspective.</answer>",1129 "visual_input": [1130 "frames/frame_000000.jpg",1131 "frames/frame_000001.jpg",1132 "frames/frame_000002.jpg",1133 "frames/frame_000003.jpg",1134 "frames/frame_000004.jpg",1135 "frames/frame_000005.jpg",1136 "frames/frame_000006.jpg",1137 "frames/frame_000007.jpg",1138 "frames/frame_000008.jpg",1139 "frames/frame_000009.jpg",1140 "frames/frame_000010.jpg",1141 "frames/frame_000011.jpg",1142 "frames/frame_000012.jpg",1143 "frames/frame_000013.jpg",1144 "frames/frame_000014.jpg",1145 "frames/frame_000015.jpg",1146 "frames/frame_000016.jpg",1147 "frames/frame_000017.jpg",1148 "frames/frame_000018.jpg",1149 "frames/frame_000019.jpg",1150 "frames/frame_000020.jpg",1151 "frames/frame_000021.jpg",1152 "frames/frame_000022.jpg",1153 "frames/frame_000023.jpg",1154 "frames/frame_000024.jpg",1155 "frames/frame_000025.jpg"1156 ]1157 }1158 ]1159 },1160 {1161 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1162 "answer": "A diver is closely interacting with a hammerhead shark in an underwater environment, which is unusual because large predatory sharks like hammerheads typically exhibit caution around humans, making such close proximity a rare and unexpected occurrence.",1163 "dimension": "SemanticReasoning",1164 "subdimension": "AbnormalEventSummarization",1165 "question_task": "VideoSummarization",1166 "question_format": "Open-endQuestion",1167 "video_id": "3gkf4wbcBlNY",1168 "video_url": "https://www.youtube.com/watch?v=zz7NSeSJPOs",1169 "video_scene": "000152_000160",1170 "id": 131,1171 "original_video_id": "zz7NSeSJPOs",1172 "turns": [1173 {1174 "id": 131,1175 "turn_id": 1,1176 "user_query": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1177 "assistant_response": "<answer>A diver is closely interacting with a hammerhead shark in an underwater environment, which is unusual because large predatory sharks like hammerheads typically exhibit caution around humans, making such close proximity a rare and unexpected occurrence.</answer>",1178 "visual_input": [1179 "frames/frame_000000.jpg",1180 "frames/frame_000001.jpg",1181 "frames/frame_000002.jpg",1182 "frames/frame_000003.jpg",1183 "frames/frame_000004.jpg",1184 "frames/frame_000005.jpg",1185 "frames/frame_000006.jpg",1186 "frames/frame_000007.jpg",1187 "frames/frame_000008.jpg"1188 ]1189 }1190 ]1191 },1192 {1193 "question": "What rare event occurred in the video? Please describe the action using a full subject-verb-object (S+V+O) structure and explain why it is unusual.",1194 "answer": "The octopus buries itself in the sandy seabed. This is unusual because while some cephalopods use sand for camouflage, the deliberate and complete burial behavior observed here is uncommon and likely serves as a specialized defensive or ambush strategy.",1195 "dimension": "SemanticReasoning",1196 "subdimension": "AbnormalEventSummarization",1197 "question_task": "VideoSummarization",1198 "question_format": "Open-endQuestion",1199 "video_id": "6GBwL4wqinPz",1200 "video_url": "https://www.instagram.com/onebreathdiver/reel/CKM8l_qBJzv",