CoolFace
Datasetpublic

KMK040412/guiowl-curated-corpus

GUI-Owl Curated Corpus This dataset publishes the full curated mobile GUI-agent supervised fine-tuning corpus in a unified norm1000 mobile_use action format. Each row pairs a mobile UI screenshot with an instruction and a normalized target tool call for training GUI agents. The published files are the curated parquet shards as produced by the source canonicalizers. No parquet shards are merged, re-sharded, or sampled during upload. Sources Source Episodes… See the full description on the dataset page: https://huggingface.co/datasets/KMK040412/guiowl-curated-corpus.

sourceHugging Faceupdated 4mo agoView on Hugging Face
0likes334downloads
Dataset Card

GUI-Owl Curated Corpus

This dataset publishes the full curated mobile GUI-agent supervised fine-tuning corpus in a unified norm1000 mobile_use action format. Each row pairs a mobile UI screenshot with an instruction and a normalized target tool call for training GUI agents.

The published files are the curated parquet shards as produced by the source canonicalizers. No parquet shards are merged, re-sharded, or sampled during upload.

Sources

SourceEpisodesStepsStep ShareParquet ShardsCoord Out Of Range
androidcontrol_par (AndroidControl)12,23267,3151.134%360
amex (AMEX)3,04638,4890.649%240
openmobile (OpenMobile)2,75427,3590.461%244
gui_odyssey (GUI-Odyssey)7,735113,6761.916%244,866
aitw (AITW)714,3275,687,34995.840%5040
Total740,0945,934,188100.000%612

Grand total: 740,094 episodes and 5,934,188 steps across 612 parquet shards.

Format

Parquet shards are stored at:

  • data/<source>/<shard>.parquet
  • reports/<source>_report.json
  • manifest.json

All sources use the same mobile GUI-agent SFT schema. Important columns are:

ColumnTypeDescription
sourcestringCanonical source identifier.
episode_idstringEpisode or trajectory identifier within the source.
step_idintStep index within the episode.
imagebinaryJPEG screenshot bytes for the current mobile UI state.
instructionstringStep-level instruction or task prompt.
target_jsonstringTool-call target using the mobile_use action format.
action_typestringNormalized action label such as click, swipe, type, wait, or terminate.
coordinatelist[int]Primary [x, y] coordinate in norm1000 space, nullable.
coordinate2list[int]Secondary [x, y] coordinate for swipes or drags, nullable.
coord_modestringCoordinate mode, expected to be guiowlnorm1000xy.
taskstringHigh-level task text when available.
appstringApplication name or package when available.
historystringSerialized prior instruction/action context when available.
screen_widthintOriginal screenshot width when available.
screen_heightintOriginal screenshot height when available.
quality_tagslist[string]Optional curation tags.

target_json contains a <tool_call> payload whose name is mobile_use. Coordinate actions use [x, y] points in guiowl_norm1000_xy, meaning both axes are normalized into the inclusive 0-1000 range.

Mixing

This repository publishes the full curated data. Source mixing ratios are applied at training time by the dataloader or sampler, not by sampling in this upload.

Reports

Each source report is copied from the corresponding curation output directory and includes the original episode count, step count, shard count, action distribution, coordinate statistics, and coordinate out-of-range count.