CoolFace
Datasetpublic

mm-eval/Mantis-Eval

sourceHugging Faceupdated 2mo agoView on Hugging Face
0likes30downloads
12 commits on main
06110ab2mo ago

metadata: migrate score_type -> score_pipeline (atomic stage contract; see mm-eval scorer docs/en/SCORING.md)

ZTWHHH
b557f613mo ago

Add manifest (metadata.json)

ZTWHHH
223c2033mo ago

Upload dataset

ZTWHHH
d89a1be3mo ago

metadata: 2026-07-07 revised taxonomy (task_type format vocabulary multiple_choice/yes_no/short_answer/free_form; score_type incl. none; re-verified protocol evidence; repaired prompt provenance)

ZTWHHH
0eec8d03mo ago

metadata: add score_type/score_params/score_protocol (official grading protocol taxonomy); task_type is now format-only (judge_scored migrated to vqa + llm_judge). See dataset-upload skill references/metadata-json.md.

ZTWHHH
ca886964mo ago

Tighten prompt_template_source.notes: explicit 5-tier classification per 2026-06-01 priority rules

ZTWHHH
af680474mo ago

Refine prompt_template_source: cite verifiable official sources per 2026-05-30 deep audit

ZTWHHH
e7705584mo ago

Populate prompt_template_source for all subsets per 2026-05-30 audit

ZTWHHH
b089e064mo ago

Update metadata.json: Apply 2026-05-19 audit template fix

ZTWHHH
93518474mo ago

Upload metadata.json with huggingface_hub

ZTWHHH
ce14fc54mo ago

Upload dataset

ZTWHHH
915bd6a4mo ago

initial commit

ZTWHHH