human-study
human_study_targetsLLMimic_Human_Study
LLMimic Human Study Data
This dataset contains anonymized data from the human study reported in:
Train Yourself as an LLM: Exploring Effects of AI Literacy on Persuasion via Role-playing LLM Training
Qihui Fan, Min Ge, Chenyan Jia, Weiyan Shi
arXiv:2604.02637
Study Overview
We conducted a 2 × 3 between-subjects study (N = 274) to evaluate LLMimic, a role-play-based, interactive, gamified AI literacy tutorial in which participants simulate the training… See the full description on the dataset page: https://huggingface.co/datasets/CHATS-Lab/LLMimic_Human_Study.robojudge_humanstudy
RoboJudge human study — annotation packages
16 self-contained, offline annotation packages covering the 800-item RoboJudge test set.
packages
items each
total
human_study_01..16.zip
50
800
Together: 800 items, no duplicates, full coverage.
All clips belonging to the same (dataset, task, episode) scene stay inside one
package, so a scene is never split across two annotators.
How to use
Download one zip and unpack it.
Double-click index.html — it… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFriends/robojudge_humanstudy.human_study
human_study
Free-form human Reddit responses derived from
snap-stanford/user_study_annotations.
The original Reddit post text comes from the HumanLM authors'
reddit_post_dict_testset.json.
Each row contains an original Reddit post in prompt and the response written
by a human-study participant in target. Model responses, generated personas,
comparison judgments, and worker identifiers are intentionally excluded.
Deduplication and splits
Source annotation… See the full description on the dataset page: https://huggingface.co/datasets/Alberto1231/human_study.PCNN-StanfordDogs-HumanStudy-Datadiffusion_human_study