datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
android-controlandroid_controlAndroidControl-Star
AndroidControl*
A curated step-level evaluation subset extracted from AndroidControl, used for static mobile GUI understanding evaluation in UI-MOPD (Multi-platform On-Policy Distillation for Continual GUI Agent Learning).
Overview
AndroidControl* contains 4,260 step-level records from 781 Android trajectories. Each record includes the trajectory identifier, step index, high-level task goal, per-step instruction, normalized action, screenshot path, screenshot… See the full description on the dataset page: https://huggingface.co/datasets/UI-MOPD/AndroidControl-Star.Android-Control
Android Control (Community Mirror)
This is a community mirror of the official Android Control dataset by Google Research, hosted on Hugging Face for easier access.
The original dataset is hosted on Google Cloud Storage at gs://gresearch/android_control/. This copy is provided to make it more accessible to the research community via Hugging Face.
Dataset Description
Android Control is a dataset for training and evaluating Android device control agents. It contains 15… See the full description on the dataset page: https://huggingface.co/datasets/leosltl/Android-Control.android_controlAndroidControlParsedWithImages-20kAndroidControl_3000_samples_trajectoryAndroidControlAndroidControl_Curated
AndroidControl-Curated: Revealing the True Potential of GUI Agents through Benchmark Purification
This is the official repository for the paper AndroidControl-Curated.
🌟 Overview
On-device virtual assistants like Siri and Google Assistant are increasingly pivotal, yet their capabilities are hamstrung by a reliance on rigid, developer-dependent APIs. GUI agents offer a powerful, API-independent alternative, but their adoption is hindered by the… See the full description on the dataset page: https://huggingface.co/datasets/batwBMW/AndroidControl_Curated.android_control_testandroidcontrol-cl
AndroidControl-CL
This repository contains the AndroidControl-CL dataset for Android GUI control and continual learning.
This dataset is released with the paper:
CGL: Advancing Continual GUI Learning via Reinforcement Fine-Tuning
Contents
images_360/: screenshot trajectories
json_type_split/: JSONL data files
parquet_convert/: Parquet files for training and evaluation
Notes
The dataset includes train/test splits by task category.
Please follow the dataset… See the full description on the dataset page: https://huggingface.co/datasets/Regimes/androidcontrol-cl.parsed_AndroidControl
Instructions for Extracting Images from AndroidControl TFRecord
Follow these steps to download and extract images from the AndroidControl TFRecord dataset.
Step 1: Download the Original AndroidControl TFRecord
Navigate to the AndroidControl TFRecord repository where the AndroidControl TFRecord is hosted.
Download the TFRecord file to your local machine or server.
Step 2: Run the Python Script to Extract Images
Ensure that extract_images.py is in the same… See the full description on the dataset page: https://huggingface.co/datasets/HarrytheOrange/parsed_AndroidControl.AndroidControlParsed-20kandroid-control-1kAndroidControlParsedWithImages-20k-TESTONLYAndroid-Control-84k
Android Control Dataset
Overview
This directory contains two dataset files (and_ctrl_train.json and and_ctrl_test.json) derived from the Android Control project by Google Research. These datasets have been formatted specifically for GUI grounding training in LLaMA-Factory.
Dataset Description
The Android Control dataset consists of episodes where each episode contains multiple steps. Each step includes:
Step instructions: Natural language instructions for UI… See the full description on the dataset page: https://huggingface.co/datasets/OfficerChul/Android-Control-84k.AndroidControl_testandroid-control
Android Control Test Set
Notes
NOTE i uploaded it so it easier for running evaluation on it
I am not responsible if you use it in training :<
I assume most models train on train-set/val-set but not test-set
I assume that the ids here are episode_id
https://console.cloud.google.com/storage/browser/_details/gresearch/android_control/splits.json , so I download data using smolagents
https://huggingface.co/datasets/smolagents/android-control and iterate and filter ids to… See the full description on the dataset page: https://huggingface.co/datasets/aliaagheis/android-control.AndroidControl-JSON-Splits
AndroidControl (JSON)
Overview
This dataset provides all splits of AndroidControl in a ready-to-use JSON format, extracted from the original Google Cloud data release.
Motivation: Most GUI agent works use GUI-Actor-Data for training, which includes AndroidControl images but does not include the test set JSON. Obtaining any split from the original source requires downloading the full dataset (~47 GB) from Google Cloud, which is cumbersome. This dataset provides all splits… See the full description on the dataset page: https://huggingface.co/datasets/endlesswinds/AndroidControl-JSON-Splits.android_control_test
Processed Android Control Test Set for InfiGUI-R1 Evaluation
Dataset Description
This repository contains the processed test set derived from the Android Control dataset by Google Research. It has been specifically prepared for evaluating the performance of our model, InfiGUI-R1.
The InfiGUI-R1 model is detailed in our paper:
InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners
This dataset facilitates standardized testing and… See the full description on the dataset page: https://huggingface.co/datasets/InfiX-ai/android_control_test.AndroidControlParsedWithImages-20k-maxnshot2android_control_train
Processed Android Control Training Set
Dataset Description
This repository contains the processed training set derived from the Android Control dataset by Google Research.
The data processing methodology is identical to that used for our corresponding test set, which can be found at Reallm-Labs/android_control_test.
Data Content and Image Extraction
Important Note: Due to the large size of the dataset, this repository contains only the processed text files.… See the full description on the dataset page: https://huggingface.co/datasets/InfiX-ai/android_control_train.AutoGUI-v1.1-AndroidControl-FuncGnd-s1000AndroidControl_testAndroidControl_debugAndroidControl_300samples_qwen2_5vlandroid_controlUIPro-AndroidControl-Data-v1AndroidControl_300_samples_v2AndroidControl_700samples_qwen2_5vl_with_history_2images