auto-rubric
vision_auto_rubricAuto-Rubric
Auto-Rubric: Learning to Extract Generalizable Criteria for Reward Modeling
This is the official dataset release for the paper: Auto-Rubric: Learning to Extract Generalizable Criteria for Reward Modeling.
This repository contains query-specific rubrics datasets where each preference pair is annotated with its own specific rubric, along with generation metadata. This dataset is used for training, analysis, and reproduction of the Auto-Rubric methodology.
Query-Specific… See the full description on the dataset page: https://huggingface.co/datasets/agentscope-ai/Auto-Rubric.HPDv3_for_Auto_Rubric
🎯 HPSv3: Towards Wid-Spectrum Human Preference Score (ICCV 2025)
Yuhang Ma1,3* Yunhao Shui1,4* Xiaoshi Wu2 Keqiang Sun1,2† Hongsheng Li2,5,6†
1Mizzen AI 2CUHK MMLab 3King’s College London 4Shanghai Jiaotong University 5Shanghai AI Laboratory 6CPII, InnoHK
*Equal Contribution †Equal Advising
Human Preference Dataset v3
Human Preference Dataset v3 (HPD v3) comprises 1.08M text-image pairs and 1.17M annotated pairwise data. To modeling… See the full description on the dataset page: https://huggingface.co/datasets/Ferrie/HPDv3_for_Auto_Rubric.
