human-annotation
VBench-2.0_human_annotation
Human Annotation of the four models used in VBench-2.0
This annotation is used in the paper:👉 arXiv:2503.21755
human_annotation_web_rm_version_1{
"total_stats": {
"total_action_data": 19016,
"total_website": 50,
"action_type": {
"bid": 852,
"coord": 848
},
"level": {
"easy": 486,
"medium": 856,
"hard": 358
},
"viewport_type": {
"full": 707,
"laptop": 698,
"mobile": 295
},
"judge_type": {
"string_match": 858,
"url_match": 836… See the full description on the dataset page: https://huggingface.co/datasets/WPRM/human_annotation_web_rm_version_1.VBench-I2V_human_annotationexample_10kbp_human_annotationsVBench_human_annotation
VBench Human Annotation
example_eval_only_10kb_human_annotations