thanhqt2002/embodied-spatial-reasoning

Embodied Spatial Reasoning Tasks

Dataset Description

This dataset is part of the embodied-spatial-reasoning project, where the agent has to actively explore the environment to determine if certain spatial relationships hold true. The tasks involve spatial reasoning with various objects and scenes. Each task includes a query about the spatial relationships between objects within a scene, which the agent must verify through exploration.

Dataset Structure

The dataset is organized so that each entry represents a single task associated with a specific scene.

Features

• —task_id: (string) Unique identifier for each task.
• —query: (string) A query describing the spatial relationship to be verified (e.g., "The object sofa is to the left of wardrobe.").
• —label: (bool) Indicates whether the spatial relationship described in the query is correct (True) or not (False).
• —constraint_name: (string) Name of the spatial relationship (e.g., "left").
• —image_url: (string) URL of the image associated with the task.
• —objects: (list) List of objects involved in the scene.
• —related_task_id: (string) Identifier of a related task. Each positive task has a corresponding negative task.
• —scene_id: (string) Identifier for the scene where the task occurs.

Example Entry

{
    "query": "The object sofa is to the left of wardrobe.",
    "label": false,
    "constraint_name": "left",
    "image_url": "https://embodied-spatial-reasoning.storage.googleapis.com/images/left/False/718c876a-a8d1-4297-b552-24ce1f136ed4.png",
    "task_id": "718c876a-a8d1-4297-b552-24ce1f136ed4",
    "objects": [
        "wardrobe",
        "sofa"
    ],
    "related_task_id": "579c553b-21dd-4a44-bcef-1da9e5fada9f",
    "scene_id": "83ce1d71-506e-43aa-8fda-13911afa6e44"
}