gui
Datasets
All datasets matching “gui”GUIOdyssey
Dataset Card for GUIOdyssey
Repository: https://github.com/OpenGVLab/GUI-Odyssey
Paper: https://arxiv.org/pdf/2406.08451
News⭐️
Latest version of GUIOdyssey released!🎉
This updated version features a larger dataset with 8,334 episodes, as well as richer semantic annotations. Compared to the previous version, we have added more fine-grained low-level instructions, image descriptions, action intentions, and context review for each step. Additionally, we provide bounding… See the full description on the dataset page: https://huggingface.co/datasets/hflqf88888/GUIOdyssey.GenNOCSGUI-Xplore
GUI-Xplore Dataset 🖥️🔍
GUI-Xplore is a novel dataset designed to improve cross-application and cross-task generalization for GUI agents. It introduces exploration videos to provide context-aware learning, enabling agents to adapt to new applications efficiently.
📌 Dataset Summary
312 apps across 33 categories from 6 major domains (Entertainment, Productivity, Health, Shopping, Travel, News).
115+ hours of exploration videos, ensuring comprehensive app interaction… See the full description on the dataset page: https://huggingface.co/datasets/9211sun/GUI-Xplore.GuidedSceneGUI-World
GUI-World: A Dataset for GUI-Orientated Multimodal Large Language Models
Dataset: GUI-World
Overview
GUI-World introduces a comprehensive benchmark for evaluating MLLMs in dynamic and complex GUI environments. It features extensive annotations covering six GUI scenarios and eight types of GUI-oriented questions. The dataset assesses state-of-the-art ImageLLMs and VideoLLMs, highlighting their limitations in handling dynamic and multi-step tasks. It provides… See the full description on the dataset page: https://huggingface.co/datasets/ONE-Lab/GUI-World.GUI-360
GUI-360°: A Comprehensive Dataset And Benchmark For Computer-Using Agents
Paper | Code
GUI-360° is a large-scale, comprehensive dataset and benchmark suite designed to advance Computer-Using Agents (CUAs).
🎯 Key Features
🔢 1.2M+ executed action steps across thousands of trajectories
💼 Popular Windows office applications (Word, Excel, PowerPoint)
📸 Full-resolution screenshots with accessibility metadata
🎨 Multi-modal trajectories with reasoning traces
✅ Both… See the full description on the dataset page: https://huggingface.co/datasets/vyokky/GUI-360.