datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
GUI-AIMA-multiturnMobile-GUI-Worldmodel-SFT
Mobile-GUI-Worldmodel-SFT
This repository contains mobile GUI agent data and auxiliary files for training and evaluating GUI world models. The data is organized around GUI trajectories: each step has a screenshot and page-state annotations such as HTML, plain text, and structured text.
Repository Layout
.
├── GUI-agent-main/ # Data annotation scripts and examples
├── eval/ # Evaluation assets
│ └── AndroidControl_images.tar.gz… See the full description on the dataset page: https://huggingface.co/datasets/xwk123/Mobile-GUI-Worldmodel-SFT.laser_gui_grounding_training_datamc_gui_cold_startgui_actor_webdataset
GUI-Actor WebDataset
A WebDataset format version of the GUI-Actor dataset for training vision-language models on GUI interaction tasks.
Usage
import webdataset as wds
# Load the dataset
dataset = wds.WebDataset("path/to/shards-*.tar")
dataset = dataset.decode("pilrgb").to_tuple("jpg", "json")
for image, metadata in dataset:
# Process image and metadata
pass
Citation
Please cite the original GUI-Actor paper if you use this dataset in your research.
two-box-judge-gui-sharded
Two-Box Judge GUI Dataset (Sharded)
A multimodal dataset for training GUI element selection models, packaged in WebDataset format for efficient streaming.
Dataset Statistics
Split
Samples
Shards
Size
Train
115,638
6
25.32 GB
Validation
12,849
1
2.82 GB
Format
This dataset uses WebDataset format - sharded tar.gz archives for efficient streaming:
train/
├── shard-00000.tar.gz
├── shard-00001.tar.gz
└── ...
Each shard contains… See the full description on the dataset page: https://huggingface.co/datasets/THU-BoZhang/two-box-judge-gui-sharded.GUI_dataOffline_Evaluation