Datasetpublic

moore12138/StateBench

StateBench StateBench is a benchmark for world-state reasoning in video continuation, introduced in the paper Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation. Code: https://github.com/AMAP-ML/StateAgent The benchmark contains 200 cross-segment continuation tasks across three difficulty levels: Level Count Description past_visible 85 The target object was visible in a prior frame — tests… See the full description on the dataset page: https://huggingface.co/datasets/moore12138/StateBench.

sourceHugging Faceapache-2.0updated 18d agoView on Hugging Face

0likes134downloads

Dataset Card

StateBench

StateBench is a benchmark for world-state reasoning in video continuation, introduced in the paper Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation.

Code: https://github.com/AMAP-ML/StateAgent

The benchmark contains 200 cross-segment continuation tasks across three difficulty levels:

Level	Count	Description
`past_visible`	85	The target object was visible in a prior frame — tests temporal memory.
`occluded_process`	65	The state change occurs while the object is occluded — tests process reasoning.
`complex_transition`	50	Multiple state transitions or conflicting cues — tests compositional reasoning.

Each task includes metadata such as id, difficulty, target_object, shots, expected_state, checklist, and reference_frames.