datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MET-Bench-Minecraft
MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models
Vanya Cohen and Raymond Mooney · ICML 2026
Paper · Publication page · Load the dataset · Citation
Domains: Chess · Shell Game · Minecraft
MET-Bench evaluates entity state tracking across text and image modalities. This repository contains the Minecraft domain.
Minecraft
Minecraft is a state prediction task involving partial observations, dynamic… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Minecraft.MET-Bench-Minecraft-Trajectories
MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models
Vanya Cohen and Raymond Mooney · ICML 2026
Paper · Evaluation code · Minecraft benchmark · Usage
Benchmark domains: Chess · Shell Game · Minecraft
Minecraft trajectories
This dataset contains the 462 source recordings used to construct the released MET-Bench Minecraft benchmark, comprising 462,235 captured observations. The recordings follow scripted… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Minecraft-Trajectories.Minecraft-ChopTree
Minecraft Wood-Chopping Scenarios
Dataset d'imitation learning (behavioral cloning) enregistré dans
Minecraft Java 1.21.1 avec un mod Fabric custom.
50 épisodes de coupe d'arbres en survie, 20 Hz, avec randomisation
de l'inventaire, de la vie et de la faim au début de chaque épisode.
Structure
data/scenario-XXXX.parquet : un fichier par épisode, une ligne par tick
meta/scenario-XXXX.json : métadonnées de l'épisode (rayons, fréquence, dimension)… See the full description on the dataset page: https://huggingface.co/datasets/OpenBlock-Team/Minecraft-ChopTree.Minecraft-Navigationminecraft_builds
minecraft builds
this dataset contains Minecraft structure blueprints stored in a Parquet file.
each row includes the structure name, block coordinates (x, y, z), and block type (mat).
source: grabcraft.com
rollout_Minecraft1_20260622_231347This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/2006gk/rollout_Minecraft1_20260622_231347.Minecraft1_recover_20260622_235206This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/2006gk/Minecraft1_recover_20260622_235206.Minecraft_20260622_192114This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/2006gk/Minecraft_20260622_192114.CPT-Java-minecraft-modsminecraft-structure-block-only