vanyacohen/MET-Bench-Minecraft
MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models Vanya Cohen and Raymond Mooney · ICML 2026 Paper · Publication page · Load the dataset · Citation Domains: Chess · Shell Game · Minecraft MET-Bench evaluates entity state tracking across text and image modalities. This repository contains the Minecraft domain. Minecraft Minecraft is a state prediction task involving partial observations, dynamic… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Minecraft.
Add complete MET-Bench evaluation instructions
Rename text evaluation configuration to evaluation_text_only
Add compact 500-example evaluation configurations
Release MET-Bench Minecraft
initial commit
