hci
Datasets
All datasets matching “hci”digital-coach
DigitalCoach Dataset
DigitalCoach is a multimodal expert-novice computer-use coaching dataset for studying how humans teach software skills through grounded dialogue.It contains 72 coaching sessions, 22,752 dialogue turns, and 28.1 hours of screen recordings, collected across 5 software applications in creativity, engineering, and productivity-oriented workflows.
Each session pairs one expert coach with one novice learner, and captures timestamped data:
dialogue transcripts… See the full description on the dataset page: https://huggingface.co/datasets/berkeley-hci/digital-coach.nptel_hciA11y-CUA
A11y-CUA Dataset
A11y-CUA is a multimodal desktop interaction dataset for accessibility-focused computer-use agent research. It contains real task trajectories recorded on Windows across two human user groups and two computer use agents (CUAs), each operating under standard and accessibility-specific conditions. Every session captures: timestamped keyboard and mouse events, browser interaction logs, accessibility trees, screen video, and system audio.
The dataset is… See the full description on the dataset page: https://huggingface.co/datasets/berkeley-hci/A11y-CUA.Reduced-A11y-CUA
Reduced A11y-CUA
A structured-data-only subset of the A11y-CUA dataset on HuggingFace.
What's different from the full dataset
The full A11y-CUA dataset includes screen recordings (screen.mp4), system audio (system_audio.wav), and microphone audio (mic_audio.wav) for every session. These files account for the large majority of the dataset's total size.
This reduced version strips all video and audio files. Every other file is identical and complete:… See the full description on the dataset page: https://huggingface.co/datasets/berkeley-hci/Reduced-A11y-CUA.soarm101-feeding-nutsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 80,
"total_frames": 74355,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:80"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/HCIS-Lab/soarm101-feeding-nuts.bi-yam-loosen-bottleThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower",
"total_episodes": 50,
"total_frames": 73268,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/HCIS-Lab/bi-yam-loosen-bottle.