CoolFace
Datasetpublic

vanyacohen/MET-Bench-Minecraft

MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models Vanya Cohen and Raymond Mooney · ICML 2026 Paper · Publication page · Load the dataset · Citation Domains: Chess · Shell Game · Minecraft MET-Bench evaluates entity state tracking across text and image modalities. This repository contains the Minecraft domain. Minecraft Minecraft is a state prediction task involving partial observations, dynamic… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Minecraft.

sourceHugging Facemitupdated 12d agoView on Hugging Face
0likes1.5kdownloads
5 commits on main
40f498b12d ago

Add complete MET-Bench evaluation instructions

vanyacohen
ae0b47413d ago

Rename text evaluation configuration to evaluation_text_only

vanyacohen
b031cc413d ago

Add compact 500-example evaluation configurations

vanyacohen
26a94db14d ago

Release MET-Bench Minecraft

vanyacohen
708fc7014d ago

initial commit

vanyacohen