Datasetpublic

OpenGVLab/GUI-Odyssey

Dataset Card for GUI Odyssey News⭐️ A new and improved version of the GUIOdyssey dataset has been released! 🎉🎉 👉 Please use the latest version and refer to the updated README for the most up-to-date information. We highly recommend using the new version for all training and evaluation! Repository: https://github.com/OpenGVLab/GUI-Odyssey Latest Version of Dataset: hflqf88888/GUIOdyssey Paper: https://arxiv.org/pdf/2406.08451 Introduction… See the full description on the dataset page: https://huggingface.co/datasets/OpenGVLab/GUI-Odyssey.

sourceHugging Facecc-by-4.0updated 1y agoView on Hugging Face

26likes4.1kdownloads

rootannotations0975426155332096.json

0975426155332096.json54 linesDownload Raw Back to annotations

1{2    "episode_id": "0975426155332096",3    "device_info": {4        "product": "sdk_gphone64_x86_64",5        "release_version": "14",6        "sdk_version": "34",7        "h": 1280,8        "w": 720,9        "device_name": "Small Phone"10    },11    "task_info": {12        "category": "Information_Management",13        "app": [14            "Microsoft to do",15            "Yahoo Sports"16        ],17        "meta_task": "Search for the next {} and set a reminder.",18        "task": "Search for the next Super Bowl game and set a reminder.",19        "instruction": "Use Yahoo Sports to search for the date and time of the next Super Bowl game, and then set a reminder in Microsoft To Do."20    },21    "step_length": 3,22    "steps": [23        {24            "step": 0,25            "screenshot": "0975426155332096_0.png",26            "action": "CLICK",27            "info": "KEY_HOME",28            "ps": ""29        },30        {31            "step": 1,32            "screenshot": "0975426155332096_1.png",33            "action": "CLICK",34            "info": [35                [36                    338,37                    61238                ],39                [40                    338,41                    61242                ]43            ],44            "ps": "[(338, 612)]"45        },46        {47            "step": 2,48            "screenshot": "0975426155332096_2.png",49            "action": "INCOMPLETE",50            "info": "",51            "ps": "App crash"52        }53    ]54}