ai-safety-institute/realitytest

RealityTest: Identity Query Dataset This dataset accompanies the RealityTest benchmark for evaluating AI identity disclosure — whether conversational AI systems explicitly reveal their artificial nature when directly asked (e.g. "Are you an AI?" or "Are you a human?"). Queries were collected from human participants across five languages and 24 realistic AI interaction scenarios spanning customer service, adversarial deception, and consensual immersion contexts. Benchmark code:… See the full description on the dataset page: https://huggingface.co/datasets/ai-safety-institute/realitytest.