ttlyy/ORD
🌋 STORM: Stimulating Trustworthy Ordinal Regression Ability of MLLMs Benchmarking All-in-one Visual Rating of MLLMs with A Comprehensive Ordinal Regression Dataset. Contents STORM Weights Dataset Evaluation Examples STORM Weights Please check out our checkpoint_STORM for public STORM checkpoints, and the instructions of how to use the weights. Dataset Data file name Size STORM_instruct_MAX_527k.jsonl 383 MB… See the full description on the dataset page: https://huggingface.co/datasets/ttlyy/ORD.
Update README.md
Upload 3 files
Delete ORD/IO_qwen_train_oc_527k.jsonl
Delete ORD/IO_qwen_train_oc_123k.jsonl
Delete ORD/IO_qwen_test_oc_80k.jsonl
Update checkpoint_STORM/trainer_state.json
Delete UTK/UTK_qwen_train_vqa.jsonl
Delete UTK/UTK_qwen_test_vqa.jsonl
Delete UTK/UTK_llava_train_oc.json
Delete UTK/UTK_llava_test_oc.json
Delete SPAQ/SPAQ_qwen_train_vqa_oc.jsonl
Delete SPAQ/SPAQ_qwen_test_vqa_oc.jsonl
Delete SPAQ/SPAQ_llava_train_oc.json
Delete TAD66K/TAD66K_qwen_train_simp_oc_5level.jsonl
Delete TAD66K/TAD66K_qwen_test_oc_5level.jsonl
Delete TAD66K/TAD66K_llava_train_oc_simp_5level.json
Delete TAD66K/TAD66K_llava_test_oc_5level.json
Delete SPAQ/SPAQ_llava_test_oc.json
Delete Morph/Morph_qwen_train_simp_oc.jsonl
Delete Morph/Morph_qwen_test_oc.jsonl
Delete Morph/Morph_llava_train_oc_simp.json
Delete Morph/Morph_llava_test_oc.json
Delete KonIQ/KonIQ_qwen_train_oc.jsonl
Delete KonIQ/KonIQ_qwen_test_oc.jsonl
Delete HCI/HCI_qwen_train_oc.jsonl
Delete HCI/HCI_qwen_test_oc.jsonl
Delete HCI/HCI_llava_train_oc.json
Delete HCI/HCI_llava_test_oc.json
Delete Eyepacs/Eyepacs_qwen_train_oc.jsonl
Delete Eyepacs/Eyepacs_qwen_test_oc.jsonl
Delete DeepDRiD/DeepDRiD_qwen_train_oc.jsonl
Delete DeepDRiD/DeepDRiD_qwen_test_oc.jsonl
Delete DeepDRiD/DeepDRiD_llava_train_oc.json
Delete DeepDRiD/DeepDRiD_llava_test_oc.json
Delete ChallengeDB/ChallengeDB_qwen_train_oc.jsonl
Delete ChallengeDB/ChallengeDB_qwen_test_oc.jsonl
Delete ChallengeDB/ChallengeDB_llava_train_oc.json
Delete ChallengeDB/ChallengeDB_llava_test_oc.json
Delete CACD/CACD_qwen_train_simp_oc.jsonl
Delete CACD/CACD_qwen_test_oc.jsonl
Delete CACD/CACD_llava_train_oc_simp.json
Delete CACD/CACD_llava_test_oc.json
Delete Aesthetic/Aesthetic_qwen_train_oc.jsonl
Delete Aesthetic/Aesthetic_qwen_test_oc.jsonl
Delete Adience/Adience_qwen_train_oc.jsonl
Delete Adience/Adience_qwen_test_oc.jsonl
Delete AVA/AVA_qwen_train_simp_oc_5level.jsonl
Delete AVA/AVA_qwen_test_oc_5level.jsonl
Delete APTOs/APTOS_qwen_train_oc.jsonl
Delete APTOs/APTOS_qwen_test_oc.jsonl
