datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
easyr1-grounding-dataset-30k-not_grounded-SE-GUI-3B-2MPFiftyOne-GUI-Grounding-Train
Dataset Card for FiftyOne GUI Grounding Training Set
Dataset Details
Dataset Description
This dataset contains 739 annotated GUI screenshots designed for training computer vision models to understand and interact with graphical user interfaces. The dataset uses the specialized COCO4GUI format, which extends the standard COCO detection format to handle GUI-specific features, interaction sequences, and rich metadata.
The dataset captures real user… See the full description on the dataset page: https://huggingface.co/datasets/Voxel51/FiftyOne-GUI-Grounding-Train.FiftyOne-GUI-Grounding-Train-with-Synthetic
Dataset Card for FiftyOne GUI Grounding Training Set with Synthetic Augmentation
Dataset Details
Dataset Description
This dataset represents a significant expansion of the original FiftyOne GUI Grounding Training Set, growing from 739 real GUI screenshots to 4,036 total samples through systematic synthetic data generation. The dataset combines authentic GUI interactions with carefully crafted synthetic variants designed to improve model robustness… See the full description on the dataset page: https://huggingface.co/datasets/Voxel51/FiftyOne-GUI-Grounding-Train-with-Synthetic.GUI_groundingWe share a comprehensive GUI instruction grounding dataset. It contains 2646 desktop screenshot images along with their annotations.
The screenshot images can be found in the folder "images" and the annotation file can be found under "annotations".
The annotation JSON largely follows the coco annotation structure with a few additional keys.
We provide 7 screen element categories:
Button,
Tab,
Text field/area,
Link,
Checkbox,
Radio button,
and List.
laser_gui_grounding_training_datagui_grounding_final_cotgui_grounding_dataset-1k
Supported Tasks
Natural Language → GUI Action Grounding
Convert user instructions into JSON action objects.
Instruction Following
Models learn to interpret varying natural language formulations (e.g., “press submit” vs “click the submit button”).
Multi-step UI Automation
Some samples involve sequences of actions (e.g., open site → type → press Enter → screenshot).
Languages
English (en)
Generated with simple variations (synonyms, phrasings).
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/ArunKr/gui_grounding_dataset-1k.Grounding-Anything-GUIFiftyOne-GUI-Grounding-Eval
Dataset Card for Dataset Name
This is a FiftyOne dataset with 2405 samples.
Installation
If you haven't already, install FiftyOne:
pip install -U fiftyone
Usage
import fiftyone as fo
from fiftyone.utils.huggingface import load_from_hub
# Load the dataset
# Note: other available arguments include 'max_samples', etc
dataset = load_from_hub("harpreetsahota/FiftyOne-GUI-Grounding-Eval")
# Launch the App
session = fo.launch_app(dataset)
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/harpreetsahota/FiftyOne-GUI-Grounding-Eval.gui_grounding_dataset-100
Supported Tasks
Natural Language → GUI Action Grounding
Convert user instructions into JSON action objects.
Instruction Following
Models learn to interpret varying natural language formulations (e.g., “press submit” vs “click the submit button”).
Multi-step UI Automation
Some samples involve sequences of actions (e.g., open site → type → press Enter → screenshot).
Languages
English (en)
Generated with simple variations (synonyms, phrasings).
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/ArunKr/gui_grounding_dataset-100.gui-grounding-gta1-10k-subset-segui-formatgui-grounding-gta1-3200-subset-segui-formatgui-grounding-gta1-subsets-segui-formatgui-grounding-gta1-3200-filteredgrounding_gui_actor_webdataset