datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
JQL-Human-Edu-Annotations
📚 JQL Multilingual Educational Quality Annotations
This dataset provides high-quality human annotations for evaluating the educational value of web documents, and serves as a benchmark for training and evaluating multilingual LLM annotators as described in the JQL paper.
📝 Dataset Summary
Documents: 511 English texts
Annotations: 3 human ratings per document (0–5 scale)
Translations: Into 35 European languages using DeepL and GPT-4o
Purpose: For training and… See the full description on the dataset page: https://huggingface.co/datasets/JQL-AI/JQL-Human-Edu-Annotations.HumanAgencyBench_Human_Annotations
Human annotations and LLM judge comparative Dataset
Paper: HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
Code: https://github.com/BenSturgeon/HumanAgencyBench/
Dataset Description
This dataset contains 60,000 evaluated AI assistant responses across 6 dimensions of behaviour relevant to human agency support, with both model-based and human annotations. Each example includes evaluations from 4 different frontier LLM models. We also provide… See the full description on the dataset page: https://huggingface.co/datasets/Experimental-Orange/HumanAgencyBench_Human_Annotations.han-human-task-clarity-annotations-v1
Human Task Clarity Annotations
This dataset annotates household instructions
based on how clear and unambiguous they are
for humanoid robotic systems.
Annotation Goal
To support research on instruction clarity
and misinterpretation reduction.
Use Cases
Instruction parsing
Language grounding
Assistive robotics research
Part of
Humanoid Network (HAN)
License
MIT
human-annotationsHumanAgencyBench_Human_Annotations
Human annotations and LLM judge comparative Dataset
Dataset Description
This dataset contains 60,000 evaluated AI assistant responses across 6 dimensions of behaviour relevant to human agency support, with both model-based and human annotations. Each example includes evaluations from 4 different frontier LLM models. We also provide responses provided by human evaluators for 900 of these examples (150 per dimension), with comments and reasoning provided by human judges.… See the full description on the dataset page: https://huggingface.co/datasets/ferocious-aardvark/HumanAgencyBench_Human_Annotations.HumanAgencyEval_Human_Annotations
Human annotations and LLM judge comparative Dataset
Dataset Description
This dataset contains 60,000 evaluated AI assistant responses across 6 dimensions of behaviour relevant to human agency support, with both model-based and human annotations. Each example includes evaluations from 4 different frontier LLM models. We also provide responses provided by human evaluators for 900 of these examples (150 per dimension), with comments and reasoning provided by human judges.… See the full description on the dataset page: https://huggingface.co/datasets/anon34957/HumanAgencyEval_Human_Annotations.