datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MET-Bench-Shell
MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models
Vanya Cohen and Raymond Mooney · ICML 2026
Paper · Publication page · Load the dataset · Citation
Domains: Chess · Shell Game · Minecraft
MET-Bench evaluates entity state tracking across text and image modalities. This repository contains the Shell Game domain.
Shell Game
A ball is placed under one of three shells. The shells are swapped pairwise, and the… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Shell.203-checkerboard-shellgameThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 16,
"total_frames": 11649,
"total_tasks": 1,
"total_videos": 48,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:16"},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/203-checkerboard-shellgame.mbgfnet-closed-shell-3d-gw-dataset
Closed-shell 3d transition-metal complexes: PBE0 + G0W0 quasiparticle dataset
2,100 closed-shell mononuclear 3d transition-metal complexes (Sc–Zn), each with a DFT (PBE0/cc-pVDZ) and a
one-shot G0W0@PBE0/cc-pVDZ quasiparticle-energy calculation, built to train and benchmark
MBGF-Net (Venturella, Li, Hillenbrand, Zhu, arXiv:2407.20384) — a graph
neural network that predicts the GW self-energy from cheap DFT quantities — on transition-metal chemistry, which
the original paper's… See the full description on the dataset page: https://huggingface.co/datasets/primateria/mbgfnet-closed-shell-3d-gw-dataset.mbgfnet-open-shell-3d-gw-dataset
Open-shell 3d transition-metal complexes: PBE0 + unrestricted G0W0 quasiparticle dataset
1,240 open-shell mononuclear 3d transition-metal complexes (Ti, V, Cr, Mn, Fe, Co, Ni; spin
multiplicity 1-6, including broken-symmetry open-shell singlets — see note below), each with a
spin-unrestricted DFT (UKS-PBE0/cc-pVDZ) and one-shot unrestricted G0W0@PBE0/cc-pVDZ (UGWAC)
quasiparticle-energy calculation, built to extend MBGF-Net
(Venturella, Li, Hillenbrand, Zhu, arXiv:2407.20384) —… See the full description on the dataset page: https://huggingface.co/datasets/primateria/mbgfnet-open-shell-3d-gw-dataset.shell-attack-evolution-dataset
Shell Honeypot Attack Request–Response Dataset
A standardized, MITRE ATT&CK–annotated dataset of post-login shell
attacks captured by Cowrie SSH/Telnet
honeypots across two collection periods — 2021–2022 and 2024. It pairs
attacker shell commands with real captured system responses, enabling both
longitudinal threat analysis and the training/evaluation of AI-driven honeypots.
This is the open-source release accompanying the paper “Unveiling Evolving
Threats: A Data Analysis… See the full description on the dataset page: https://huggingface.co/datasets/zyw-286/shell-attack-evolution-dataset.stack_edu_shellmbgfnet-closed-shell-4d5d-gw-dataset
Closed-shell 4d/5d transition-metal complexes: PBE0 + G0W0 quasiparticle dataset
2,210 closed-shell mononuclear 4d and 5d transition-metal complexes (17 metals: Y, Zr, Nb, Mo, Ru,
Rh, Pd, Ag, Cd from the 4d row; Hf, Ta, W, Re, Os, Ir, Pt, Au, Hg from the 5d row), each with a DFT
(PBE0/cc-pVDZ, relativistic small-core pseudopotential on the metal) and a one-shot G0W0@PBE0
quasiparticle-energy calculation. Built to extend MBGF-Net
(Venturella, Li, Hillenbrand, Zhu… See the full description on the dataset page: https://huggingface.co/datasets/primateria/mbgfnet-closed-shell-4d5d-gw-dataset.hft-market-data-1minSoftHateBench
SoftHateBench
SoftHateBench is a benchmark for evaluating moderation models against reasoning-driven, policy-compliant hostility (“soft hate speech”). It accompanies the WWW 2026 accepted paper SoftHateBench: Evaluating Moderation Models Against Reasoning-Driven, Policy-Compliant Hostility.
Content warning: This dataset contains offensive and hateful content and is released solely for research on safety and moderation.
Dataset summary
SoftHateBench generates… See the full description on the dataset page: https://huggingface.co/datasets/Shelly97/SoftHateBench.xarm7_beavrsim_shellgame_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 100,
"total_frames": 41409,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:100"},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/arclabmit/xarm7_beavrsim_shellgame_dataset.xarm7_beavrsim_shellgame_small_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 50,
"total_frames": 24663,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/aposadasn/xarm7_beavrsim_shellgame_small_dataset.196-ShellGame-LeftCupThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 3,
"total_frames": 1790,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:3"},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/196-ShellGame-LeftCup.196-ShellGame-RightCupThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 3,
"total_frames": 1791,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:3"},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/196-ShellGame-RightCup.196-ShellGame-MiddleCupThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 3,
"total_frames": 1790,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:3"},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/196-ShellGame-MiddleCup.eval_smolvla_shell_mix1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 1,
"total_frames": 1386,
"total_tasks": 1,
"total_videos": 3,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/juni3227/eval_smolvla_shell_mix1.shell_game_touch_vla_v0
shell_game_touch_vla_v0
LeRobot-format (codebase v3.0) dataset extracted from mikasa-robo/mikasa-robo-vla-lerobot (subfolder shell_game_touch_vla_v0).
Robot type: mikasa_robo
Episodes: 250
Frames: 5378
Cameras: observation.images.top, observation.images.wrist
All credit for the data goes to the original authors.
xarm7_beavrsim_shellgame_labeled_dataset_fixedThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 100,
"total_frames": 36253,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/aposadasn/xarm7_beavrsim_shellgame_labeled_dataset_fixed.xarm7_beavrsim_shellgame_labeled_cartesianThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "xarm7",
"total_episodes": 100,
"total_frames": 36253,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/aposadasn/xarm7_beavrsim_shellgame_labeled_cartesian.eval_act_shell_mix1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 1,
"total_frames": 712,
"total_tasks": 1,
"total_videos": 3,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/juni3227/eval_act_shell_mix1.instruct-python-500kmnesh-shell-commandsmikasa-robo-vla-shell_game_push_vla_v0
Physically merged MIKASA-Robo-VLA LeRobot-v3 dataset
Source repo: mikasa-robo/mikasa-robo-vla-lerobot
Merged folders:
shell_game_push_vla_v0
This dataset was physically merged into one root-level LeRobot-v3 dataset.
Important: meta/stats.json is copied from the first source dataset as a fallback. Recompute stats with your LeRobot version before long training if possible.
shellm-V3-simple-unixCoRe
