Spa-Bench/spa-bench-eval-rollouts-groot-n1-7-frozen-llm-full
Spa-Bench Evaluation Rollouts — GR00T-N1.7 Frozen LLM (Full) Open this dataset in the LeRobot visualizer This repository contains physical Spa-Bench rollout trajectories with synchronized middle and wrist RGB video, robot state, action, timestamps, episode indices, and task indices. The native Hugging Face Data Studio viewer is enabled through the Parquet files declared above. Dataset summary Coverage: 900 scored recordings. Format: LeRobot v3 at 30 FPS. Task… See the full description on the dataset page: https://huggingface.co/datasets/Spa-Bench/spa-bench-eval-rollouts-groot-n1-7-frozen-llm-full.
Spa-Bench Evaluation Rollouts — GR00T-N1.7 Frozen LLM (Full)
Open this dataset in the LeRobot visualizer
This repository contains physical Spa-Bench rollout trajectories with synchronized middle and wrist RGB video, robot state, action, timestamps, episode indices, and task indices. The native Hugging Face Data Studio viewer is enabled through the Parquet files declared above.
Dataset summary
- Coverage: 900 scored recordings.
- Format: LeRobot v3 at 30 FPS.
- Task families: Counting, Ordinal Position, Physical State, Referential Description, Relational Placement, and Relative Size.
- Evaluated model: `spa-bench-model-groot-n1-7-frozen-llm-epoch-12`.
- Evaluation annotations: `spa-bench-data-information`.
Use and limitations
The data support benchmark inspection and reproduction of the reported physical evaluation. Results apply to the released checkpoints, embodiment, workspace, cameras, objects, prompts, and protocol. Review incidental laboratory imagery before redistributing extracted frames.
Double-blind release note
Author, institution, source-repository, and archival citation details are intentionally omitted during review. They will be restored in the archival release.