datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Agent-ValueBench
Agent-ValueBench
Agent-ValueBench constitutes the first comprehensive benchmark dedicated to evaluating the underlying values of autonomous agents. It features 394 executable environments across 16 domains, offering 4,335 value-conflict tasks that span 28 value systems (332 dimensions).
This Hugging Face release contains both structured JSONL tables for dataset viewing and Croissant metadata generation, and the original raw benchmark artifacts.
Repository Structure… See the full description on the dataset page: https://huggingface.co/datasets/anonymous-nips2026/Agent-ValueBench.piperx-demo558-value1500-a50-top10-union20-v1
PiperX advantage-selected teleoperation segments
Only pure human demonstrations. Value checkpoint step1500 (mixed demo+HIL); no HIL frames in this export.
A50 ranked globally across 558 source episodes, top10% AND A>0. Every selected start expands to [t,t+20); overlaps and adjacency merge. Each disconnected component is a separate output episode. Interior frames need not themselves be top10%.
Output: 7146 segments, 322261 frames, 2.983898 hours at30FPS.
Three camera streams and… See the full description on the dataset page: https://huggingface.co/datasets/Elvinky/piperx-demo558-value1500-a50-top10-union20-v1.Agent-ValueBench
Agent-ValueBench
Paper | Project Page | GitHub
Agent-ValueBench is the first comprehensive benchmark dedicated to evaluating the underlying values of autonomous agents. It features 394 executable environments across 16 domains, offering 4,335 value-conflict tasks that span 28 value systems (332 dimensions).
Repository Structure
README.md
data/
cases.jsonl
rubrics.jsonl
environments.jsonl
raw/
case/
rubric/
environment/
Data Files… See the full description on the dataset page: https://huggingface.co/datasets/Value4AI/Agent-ValueBench.Think_and_Query_value_for_R1
Introduction
This repository implements a Shapley value-based approach to quantitatively evaluate the contributions of query (q) and think (t) in generating answer (a).
Method
think_value = [loss(a|q) - loss(a|q,t) + loss(a|∅) - loss(a|t)] / 2
query_value = [loss(a|t) - loss(a|q,t) + loss(a|∅) - loss(a|q)] / 2
think_ratio = think_value/loss(a|∅)
query_ratio = query_value/loss(a|∅)
Original dataset… See the full description on the dataset page: https://huggingface.co/datasets/caihuaiguang/Think_and_Query_value_for_R1.orbit-wars-value-v2anchor-actionsorbit-wars-value-v2anchor
