datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Real-UI-Clickboxes
RUC: Real UI Clickboxes
Click carefully, even when the page is trying to trick you! 👀
Official Hugging Face release for RUC: Real UI Clickboxes, the dataset accompanying our ACL 2026 paper Don't Click That: Teaching Web Agents to Resist Deceptive Interfaces on deceptive UI understanding for web agents.
ACL Anthology: https://aclanthology.org/2026.acl-long.310/
PDF: https://aclanthology.org/2026.acl-long.310.pdf
DOI: https://doi.org/10.18653/v1/2026.acl-long.310… See the full description on the dataset page: https://huggingface.co/datasets/DUDE-Framework/Real-UI-Clickboxes.RoboTwin_click_bell_randomizedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "aloha",
"total_episodes": 500,
"total_frames": 36818,
"total_tasks": 390,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 15,
"splits": {
"train": "0:500"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/suz22/RoboTwin_click_bell_randomized.RoboTwin_click_alarmclock_randomizedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "aloha",
"total_episodes": 500,
"total_frames": 40661,
"total_tasks": 429,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 15,
"splits": {
"train": "0:500"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/suz22/RoboTwin_click_alarmclock_randomized.Click-100k
🖱️ Click-100k Dataset
🍨 Blog Post / Codebase
Click-100k is a high-quality grounding dataset used to train 🍨 Gelato-30B-A3B a state-of-the-art grounding model for GUI computer-use tasks. The dataset pairs computer screen frames with low-level GUI commands and click coordinates, enabling models to learn precise UI element interaction. Click-100k was built by filtering and unifying multiple public datasets and enriching them with professional application data.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/Click-100k.agentnet-clicks
agentnet-clicks
AgentNet click grounding dataset prepared with agentnet-parse.py.
Generation Details
Script: agentnet-parse.py
Datasets: ubuntu, winmac
Total samples: 109855
Shard size: 1000
Prompt format: gta1
Output format: coordinates
Image resize limit: 4.0 MP
Max actions per trajectory: 5
Sample Entry
Dataset: ubuntu
Prompt:
Click on the GIMP application icon in the left taskbar to launch the image editing software.
Assistant: (35,554)
Bounding… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-cua-dev/agentnet-clicks.100k-click-5k-refusal-conf-prompt100k-click-5k-refusal-no-conf-promptclick_alarmclock_25_10_08_openpi_lerobotshowdown-clicks
showdown-clicks
General Agents
🤗 Dataset | GitHub
showdown is a suite of offline and online benchmarks for computer-use agents.
showdown-clicks is a collection of 5,679 left clicks of humans performing various tasks in a macOS desktop environment. It is intended to evaluate instruction-following and low-level control capabilities of computer-use agents.
As of March 2025, we are releasing a subset of the full set, showdown-clicks-dev, containing 557 clicks. All examples are… See the full description on the dataset page: https://huggingface.co/datasets/generalagents/showdown-clicks.agentnet-clicks-rescaledClick-100krobotwin_piper_dual_click_bellcaptcha_chinese_click_1clickbait_binarydocvqa_clicars_facturavenda_Mireia_600_3Piper_click_bell_0403
Piper LeRobot Dataset
Generated on 2026-04-20 by convert_piper_hdf5_to_lerobot.py.
Summary
Repo id: ZhaoRunyi/Piper_click_bell_0403
Robot type: aloha
Input dir: /home/edemlab/challenge_ws/control_your_robot/example/teleop/save/dual_piper_data/click_bell
Output dir: /home/edemlab/challenge_ws/data/ZhaoRunyi/Piper_click_bell_0403
FPS: 10
Sampling mode: full
Leading group: slave_cam_high
Crop strategy: LATEST_START
Default leading tolerance: 0.1 s
Additional constraints: []… See the full description on the dataset page: https://huggingface.co/datasets/ZhaoRunyi/Piper_click_bell_0403.docvqa_clicars_informeitv_Mireia_80_9easyr1-showdown-clicks-eval-4MPdocvqa_clicars_permiscirculacio_Mireia_180_2docvqa_clicars_ITV_Mireia_191_11_13032024docvqa_clicars_histmant_Mireia_120_4docvqa_clicars_fitxatecnica_Mireia_270_5easyr1-showdown-clicks-eval-2MPClick-100k-50-samples