datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
GUIOdyssey
Dataset Card for GUIOdyssey
Repository: https://github.com/OpenGVLab/GUI-Odyssey
Paper: https://arxiv.org/pdf/2406.08451
News⭐️
Latest version of GUIOdyssey released!🎉
This updated version features a larger dataset with 8,334 episodes, as well as richer semantic annotations. Compared to the previous version, we have added more fine-grained low-level instructions, image descriptions, action intentions, and context review for each step. Additionally, we provide bounding… See the full description on the dataset page: https://huggingface.co/datasets/hflqf88888/GUIOdyssey.GUI-Odyssey
Dataset Card for GUI Odyssey
News⭐️
A new and improved version of the GUIOdyssey dataset has been released! 🎉🎉
👉 Please use the latest version and refer to the updated README for the most up-to-date information.
We highly recommend using the new version for all training and evaluation!
Repository: https://github.com/OpenGVLab/GUI-Odyssey
Latest Version of Dataset: hflqf88888/GUIOdyssey
Paper: https://arxiv.org/pdf/2406.08451
Introduction
GUI Odyssey is… See the full description on the dataset page: https://huggingface.co/datasets/OpenGVLab/GUI-Odyssey.GUIGuard-Bench
GUIGuard-Bench (Public Ladder)
GUIGuard-Bench is a cross-platform GUI agent benchmark for studying privacy risks and privacy-preserving execution in multimodal GUI agents.
This public-ladder release contains 121 GUI interaction trajectories (68 Android + 53 PC) for benchmark evaluation, with 26,407 region-level privacy annotations across 2,002 screenshots.
For the anonymous review version of the evaluation toolkit, see GUIGaurd-Bench-CA4F.
Dataset Summary
GUI agents… See the full description on the dataset page: https://huggingface.co/datasets/ShaofantuoshuzhengzhiSha/GUIGuard-Bench.GUIOdyssey
Dataset Card for GUIOdyssey
Repository: https://github.com/OpenGVLab/GUI-Odyssey
Paper: https://arxiv.org/pdf/2406.08451
News⭐️
Latest version of GUIOdyssey released!🎉
This updated version features a larger dataset with 8,334 episodes, as well as richer semantic annotations. Compared to the previous version, we have added more fine-grained low-level instructions, image descriptions, action intentions, and context review for each step. Additionally, we provide… See the full description on the dataset page: https://huggingface.co/datasets/hsinv/GUIOdyssey.guiowl-aw-mix-full
GUI-Owl AndroidWorld SFT Mix — FULL / generalization
Purpose: AndroidWorld (116-task) SFT for a GUI-Owl-1.5-2B block-diffusion VLA.
This dataset is an action-balanced, source-mixed SFT corpus assembled from five Android
GUI-agent trajectory sources. It is built for in-domain supervised fine-tuning ahead of RL.
The mix deliberately includes AndroidWorld task-family coverage (via the openmobile anchor,
whose app field holds AW task-family names) and accepts in-domain overlap by… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/guiowl-aw-mix-full.fineweb-atlas
FineWeb Atlas (v0.1)
FineWeb Atlas annotates 14.9 million FineWeb documents (95.5M chunks, 10.2B tokens) with 16,790 human-readable concepts spanning entities, topics, tones, and document types. Each chunk receives ~15 concept labels on average. The release includes chunk- and document-level annotations, a concept metadata table with prevalence stats, a reverse index for concept-first retrieval, and a packed cooccurrence matrix.
For background on how the atlas was built, see the… See the full description on the dataset page: https://huggingface.co/datasets/guidelabs/fineweb-atlas.ctu_datasetsguiowl-aw-mix-targeted
GUI-Owl AndroidWorld SFT Mix — TARGETED / in-domain
Purpose: AndroidWorld (116-task) SFT for a GUI-Owl-1.5-2B block-diffusion VLA.
This dataset is an action-balanced, source-mixed SFT corpus assembled from five Android
GUI-agent trajectory sources. It is built for in-domain supervised fine-tuning ahead of RL.
The mix deliberately includes AndroidWorld task-family coverage (via the openmobile anchor,
whose app field holds AW task-family names) and accepts in-domain overlap by… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/guiowl-aw-mix-targeted.guiowl-aw-mix-hybrid-packed
guiowl-aw-mix-hybrid-packed
Episode-PACKED AndroidWorld-SFT mix for GUI-Owl-1.5-2B block-diffusion VLA.
600,040 steps / 57,669 episodes (whole-episode, ordered, action-trace history). 151 shards.
Source mix: openmobile 28% (AW-app anchor), gui_odyssey 26% (long/cross-app), aitw 18% (visual ballast), androidcontrol 16% (open donor), amex 12%.
Episode-presence: type 64% / swipe 57% / terminate 45% / open 13% / answer 7%. ep_len mean 10.4, p90 20, max 60.
Validated:… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/guiowl-aw-mix-hybrid-packed.spine
GUI World Model — Spine Transitions
(s, a, s') transitions collected by walking task instructions on a live
Ubuntu desktop. Every state is captured from the running machine: a screenshot,
the accessibility tree as XML, and the rendered element table the model reads.
This set is spine only — the path an agent actually took. No branches.
Where the instructions come from
instruction_source
what it is
agentnet
Human recordings of people using their own… See the full description on the dataset page: https://huggingface.co/datasets/gui-wm/spine.agentnet-partial-and-fail-v1
agentnet-partial-and-fail-v1
GUI state transitions (s, a, s') walked on an Ubuntu desktop by
Qwen3.8-27B, from tasks taken from AgentNet and run inside OSWorld's
Docker environment.
Walks the judge ruled partial or failed. These are the larger half and, for a world model, the more useful one: a walk that did not finish still opened dialogs, switched tabs and changed settings, and each of those is a real transition. Measured over eighty-eight walks, a failure visits 13.5 distinct… See the full description on the dataset page: https://huggingface.co/datasets/gui-wm/agentnet-partial-and-fail-v1.AIRBOT_MMK2_play_the_guitar
AIRBOT_MMK2_play_the_guitar
📋 Overview
This dataset uses an extended format based on LeRobot and is fully compatible with LeRobot.
Robot Type: discover_robotics_aitbot_mmk2
| Codebase Version: v2.1
End-Effector Type: five_finger_hand
🏠 Scene Types
This dataset covers the following scene types:
home
🤖 Atomic Actions
This dataset includes the following atomic actions:
grasp
pick
place
pull
📊 Dataset Statistics
Metric
Value… See the full description on the dataset page: https://huggingface.co/datasets/RoboCOIN/AIRBOT_MMK2_play_the_guitar.guiowl-aw-mix-phoneonly-packedpose-guided-fall-detection-icta2026
Pose-Guided Temporal Modeling for Robust Vision-Based Fall Detection
This repository contains a reproducible vision-based fall detection pipeline for an ICTA-style technical paper. It focuses on pose/keypoint dynamics, lightweight temporal modeling, ablation, and robustness tests on a 24 GB RTX 3090.
What is included
Dataset manifest builder for URFD, Multiple Cameras Fall Dataset, and generic video folders.
Pose extraction with YOLO pose models from sampled… See the full description on the dataset page: https://huggingface.co/datasets/MahedixHasan/pose-guided-fall-detection-icta2026.guiowl-curated-corpus
GUI-Owl Curated Corpus
This dataset publishes the full curated mobile GUI-agent supervised fine-tuning corpus in a unified norm1000 mobile_use action format. Each row pairs a mobile UI screenshot with an instruction and a normalized target tool call for training GUI agents.
The published files are the curated parquet shards as produced by the source canonicalizers. No parquet shards are merged, re-sharded, or sampled during upload.
Sources
Source
Episodes… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/guiowl-curated-corpus.widowxai-organize-table-generic-0-30ep-30v_20260825_160145This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-organize-table-generic-0-30ep-30v_20260825_160145.pose-guided-fall-detection-icta2026
Pose-Guided Temporal Modeling for Robust Vision-Based Fall Detection
This repository contains a reproducible vision-based fall detection pipeline for an ICTA-style technical paper. It focuses on pose/keypoint dynamics, lightweight temporal modeling, ablation, and robustness tests on a 24 GB RTX 3090.
What is included
Dataset manifest builder for URFD, Multiple Cameras Fall Dataset, and generic video folders.
Pose extraction with YOLO pose models from sampled… See the full description on the dataset page: https://huggingface.co/datasets/minhy112/pose-guided-fall-detection-icta2026.GUIOdyssey
Dataset Card for GUIOdyssey
Repository: https://github.com/OpenGVLab/GUI-Odyssey
Paper: https://arxiv.org/pdf/2406.08451
News⭐️
Latest version of GUIOdyssey released!🎉
This updated version features a larger dataset with 8,334 episodes, as well as richer semantic annotations. Compared to the previous version, we have added more fine-grained low-level instructions, image descriptions, action intentions, and context review for each step. Additionally, we provide bounding… See the full description on the dataset page: https://huggingface.co/datasets/jinghang290038/GUIOdyssey.gui-libra-aw-packed
GUI-Libra AW-Packed (mobile_use, episode-packed)
Curated from GUI-Libra/GUI-Libra-81K-SFT (android subsets: aitw, amex,
android_control, gui-odyssey, coat-terminal) into the Fast-dVLM / GUI-Owl-1.5-2B
packed-parquet schema, action-balanced for AndroidWorld.
Schema matches KMK040412/guiowl-aw-mix-hybrid-packed EXACTLY:
source, episode_id, step_id, app, instruction, history, screenshot, screen_width, screen_height, target_json, action_type, coordinate, coordinate2, ep_len.… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/gui-libra-aw-packed.gui_parquet_hfGuiaCat
Dataset Card for GuiaCat
Dataset Summary
GuiaCat is a dataset consisting of 5.750 restaurant reviews in Catalan, with 5 associated scores and a label of sentiment. The data was provided by GuiaCat and curated by the BSC.
This work is licensed under a Creative Commons Attribution Non-commercial No-Derivatives 4.0 International License.
Supported Tasks and Leaderboards
This corpus is mainly intended for sentiment analysis.
Languages
The… See the full description on the dataset page: https://huggingface.co/datasets/projecte-aina/GuiaCat.open-materials-guide-2024
Open Materials Guide (OMG) Dataset
The OMG dataset is a collection of 17,000+ expert-verified synthesis recipes from open-access literature. It supports research in materials science and machine learning, enabling tasks such as raw materials prediction, synthesis procedure generation, and characterization outcome forecasting.
For more details, see our paper: Towards Fully-Automated Materials Discovery via Large-Scale Synthesis Dataset and Expert-Level LLM-as-a-Judge.
Key Features:… See the full description on the dataset page: https://huggingface.co/datasets/iknow-lab/open-materials-guide-2024.gui-libra-aw-packed-phone
GUI-Libra AW-Packed PHONE-PORTRAIT (mobile_use, episode-packed)
Phone-portrait-only filter of
KMK040412/gui-libra-aw-packed,
maximizing AndroidWorld (phone-portrait benchmark) relevance.
Drop criterion: an episode is landscape (dropped) if any of its steps has
screen_height / screen_width < 1.0. Portrait episodes are kept fully and intact.
Filtering is episode-level so multi-turn episodes stay contiguous.
Schema is byte-identical to the source (same columns/dtypes, target_json… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/gui-libra-aw-packed-phone.guided-rlwidowxai-fold-cloth-1_20260825_154027This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-fold-cloth-1_20260825_154027.widowxai-fold-cloth-0_20260825_152912This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-fold-cloth-0_20260825_152912.widowxai-fold-cloth-2_20260825_154251This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"joint_0.pos",
"joint_1.pos",
"joint_2.pos",
"joint_3.pos",
"joint_4.pos",
"joint_5.pos",
"left_carriage_joint.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/Guilhermefrazao/widowxai-fold-cloth-2_20260825_154251.GUIOdyssey
Dataset Card for GUIOdyssey
Repository: https://github.com/OpenGVLab/GUI-Odyssey
Paper: https://arxiv.org/pdf/2406.08451
News⭐️
Latest version of GUIOdyssey released!🎉
This updated version features a larger dataset with 8,334 episodes, as well as richer semantic annotations. Compared to the previous version, we have added more fine-grained low-level instructions, image descriptions, action intentions, and context review for each step. Additionally, we provide bounding… See the full description on the dataset page: https://huggingface.co/datasets/dad3131/GUIOdyssey.gui-primitives
GUI-Primitives
A controlled minimal-pair diagnostic benchmark for the elementary spatial primitives
that GUI click instructions depend on.
Author(s): Md Abrar Jahin, Md Rizwan Parvez
Accepted at EMNLP 2026 (Main Conference).
VLM-based computer-use agents fail largely at grounding — turning a language
instruction into a click coordinate. Existing spatial-reasoning benchmarks
(What's-Up, BLINK, CV-Bench, VSR) use natural photographs, not screenshots, and none
isolate which… See the full description on the dataset page: https://huggingface.co/datasets/kagnlp/gui-primitives.guiowl-aw-mix-hybrid
GUI-Owl AndroidWorld SFT Mix — HYBRID / recommended
Purpose: AndroidWorld (116-task) SFT for a GUI-Owl-1.5-2B block-diffusion VLA.
This dataset is an action-balanced, source-mixed SFT corpus assembled from five Android
GUI-agent trajectory sources. It is built for in-domain supervised fine-tuning ahead of RL.
The mix deliberately includes AndroidWorld task-family coverage (via the openmobile anchor,
whose app field holds AW task-family names) and accepts in-domain overlap by… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/guiowl-aw-mix-hybrid.