mlfoundations-cua-dev/easyr1-10k-hard-qwen7b-easy-gta1-4MP-no-gta1-filter-on-omniact-pc-e-showui-desktop

easyr1-10k-hard-qwen7b-easy-gta1-4MP-no-gta1-filter-on-omniact-pc-e-showui-desktop

This dataset was generated using the EasyR1 grounding dataset pipeline.

Generation Details

• —Generated on: 2025-08-26 00:22:03 UTC
• —Script: push_easyr1_to_hf.py
• —Data directory: /lustre/fsw/portfolios/nvr/users/aawadalla/LLaMA-Factory/data

Parameters Used

• —Maximum samples: 10000
• —Image resize (max megapixels): 4.0 MP
• —Minimum native image resolution: 0.0 MP
• —Prompt format: gta1_with_resolution
• —Output format: coordinates
• —Random seed: 42
• —Resampling enabled: False
• —Icon upsampling ratio: Disabled (random sampling)
• —pc-agent-e deduplication: False

Dataset Groups

The following JSON/JSONL files were used to create this dataset:

Dataset Group 1

Files (intersection of kept samples across all files):

• —grounding-data-filters/pixmo-points-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl
• —grounding-data-filters/pixmo-points-gta1-correctlygrounded-HelloKKMeGTA1-7B-gta1.jsonl

Dataset Group 2

Files (intersection of kept samples across all files):

• —grounding-data-filters/autogui-grounding-only-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl
• —grounding-data-filters/autogui-grounding-only-gta1-correctlygrounded-HelloKKMeGTA1-7B-gta1.jsonl

Dataset Group 3

Files (intersection of kept samples across all files):

• —grounding-data-filters/seeclick-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl
• —grounding-data-filters/seeclick-gta1-correctlygrounded-HelloKKMeGTA1-7B-gta1.jsonl

Dataset Group 4

• —grounding-data-filters/pc-e-grounding-only-claude-instructions-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl

Dataset Group 5

• —grounding-data-filters/omniact-grounding-only-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl

Dataset Group 6

• —grounding-data-filters/showui-desktop-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl

Dataset Group 7

Files (intersection of kept samples across all files):

• —grounding-data-filters/showui-web-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl
• —grounding-data-filters/showui-web-gta1-correctlygrounded-HelloKKMeGTA1-7B-gta1.jsonl

Dataset Group 8

Files (intersection of kept samples across all files):

• —grounding-data-filters/uground-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl
• —grounding-data-filters/uground-gta1-correctlygrounded-HelloKKMeGTA1-7B-gta1.jsonl

Dataset Group 9

Files (intersection of kept samples across all files):

• —grounding-data-filters/waveui-qwentoolcall-notgrounded-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl
• —grounding-data-filters/waveui-gta1-correctlygrounded-HelloKKMeGTA1-7B-gta1.jsonl

Dataset Group 10

• —grounding-data-filters/professional-apps-grounding-filtered-gta1-7b-converted-notgrounded-qwen25vl7b-QwenQwen2.5-VL-7B-Instruct-qwentoolcall.jsonl

Dataset Statistics

• —Total training samples: 10000
• —Image dimensions: Variable
• —Columns: imagepath, prompt, normalizedbbox, images, easyr1prompt, bbox, messages, originalimagewidth, imagewidth, image_height

System Prompt

The following system prompt is used for this dataset:

You are an expert UI element locator. Given a GUI image and a user's element description, provide the coordinates of the specified element as a single (x,y) point. The image resolution is height 2048 and width 2048. For elements with area, return the center point.

Output the coordinate pair exactly:
(x,y)

Sample Entry

• —User prompt: <image> In this web page capture, please predict the positions of the element I describe (with point). This element provides a direct access point to the website's main content or homepage.
• —Assistant response: (62,30)
• —Bounding box: [25, 20, 100, 41]
• —Image path: autogui-images/autogui20701945fa9bbbd.png

Usage

from datasets import load_dataset

dataset = load_dataset("mlfoundations-cua-dev/easyr1-10k-hard-qwen7b-easy-gta1-4MP-no-gta1-filter-on-omniact-pc-e-showui-desktop")

# Access the training data
train_data = dataset['train']

# Example: Get the first sample
sample = train_data[0]
images = sample['images']
messages = sample['messages']
bbox = sample['bbox']

Prompt Formats

gta1withresolution

GTA1 format with image resolution included in the system prompt. Outputs coordinates in (x,y) format.

License

Please refer to the original dataset licenses for usage restrictions.