xraijobsimulator/CLEVER_Job_Simulator

The Capturing and Logging Ecological Virtual Experiences and Reality (CLEVER) — Job Simulator Dataset

This repository consists of data from 95 participants playing the SteamVR game "Job Simulator". We collected data using two VR systems: a Meta Quest 3S and a VIVE XR Elite. Each participant experienced 5 sessions in which they played through the first three tasks in Office Worker, responded to the Fidelity-based Presence Scale and Simulator Sickness Questionnaire, played through the first three tasks in Store Clerk, and then completed the same two questionnaires.

Features

• —Pose and interaction CSV with the number of active devices, 3D position (x, y, z), quaternion rotation (x, y, z, w), linear velocity (x, y, z), and angular velocity (x, y, z) for the HMD and both controllers, along with the number of interactions.
• —Fidelity-based Presence Scale (FPS) and Simulator Sickness Questionnaire (SSQ) responses in consolidated Excel sheets and individual CSV files
• —MP4 recording of each session
• —Project_Properties CSV capturing metadata about the recording session
• —PID Information Excel Sheet with PID, date and time of data collection, gender, device order, and session quality notes
• —Background Survey Responses with PID, gender, age, hand dominance, frequency of playing video games, skill level in video games, frequency of experiencing virtual reality, and skill level in virtual reality experiences
• —PID-Specific Notes [Coming Soon]

File Hierarchy

<PID>/                                              # 5-digit unique participant identifier, e.g. 10340
├── JobSimulator_<PID>__1/
│   ├── Poses/
│   │   └── Poses_and_Interactions_<Timestamp>.csv     # active device count; HMD + controller position (x,y,z),
│   │                                                   # rotation (x,y,z,w), linear velocity (x,y,z),
│   │                                                   # angular velocity (x,y,z); interaction count per timestamp
│   ├── Questionnaires/
│   │   ├── <Timestamp>_Fidelity-based Presence Scale.csv     # 2 rows (pre/post administration)
│   │   └── <Timestamp>_Simulator Sickness Questionnaire.csv  # 2 rows (pre/post administration)
│   ├── Videos/
│   │   ├── <Timestamp>_muted.mp4                      # session recording
│   │   └── transcript/
│   │       ├── <Timestamp>_corrected.json
│   │       └── <Timestamp>_corrected.srt
│   └── Project_Properties_<Timestamp>.csv             # session-level recording metadata
│
├── JobSimulator_<PID>__2/
├── JobSimulator_<PID>__3/
├── JobSimulator_<PID>__4/
└── JobSimulator_<PID>__5/

Citation

If you use this dataset, please cite:

Qidi J. Wang, Xiaozheng Wang, Akhilesh M. Anand, Veera V. Pala, Rohan V. Penmetsa, and Ryan P. McMahan, "The Capturing and Logging Ecological Virtual Experiences and Reality (CLEVER) — Job Simulator Dataset," arXiv preprint arXiv:2608.13715, [2026].

@misc{wang_2026_clever_jobsimulator,
      title={The Capturing and Logging Ecological Virtual Experiences and Reality (CLEVER) - Job Simulator Dataset}, 
      author={Qidi J. Wang and Xiaozheng Wang and Akhilesh M. Anand and Veera V. Pala and Rohan V. Penmetsa and Ryan P. McMahan},
      year={2026},
      eprint={2608.13715},
      archivePrefix={arXiv},
      primaryClass={cs.HC},
      url={https://arxiv.org/abs/2608.13715}, 
}