CoolFace
Datasetpublic

QRP123/rmbench-cover-blocks-smolvla-ttt-stage1plus2-videos

RMBench Cover Blocks: SmolVLA-TTT Stage1+2 videos Four qualitative episodes from the Stage1+2 checkpoint. Each episode uses an independent model server so TTT fast state cannot leak between samples. Videos use the official demo_clean configuration with unseen instructions. They are qualitative samples; the separate canonical 100-episode formal evaluation is recorded in metadata.json. Video GPU Canonical seed Success Instruction Open video 1 0 100000 no On the table… See the full description on the dataset page: https://huggingface.co/datasets/QRP123/rmbench-cover-blocks-smolvla-ttt-stage1plus2-videos.

sourceHugging Faceupdated 28d agoView on Hugging Face
0likes120downloads
Dataset Card

RMBench Cover Blocks: SmolVLA-TTT Stage1+2 videos

Four qualitative episodes from the Stage1+2 checkpoint. Each episode uses an independent model server so TTT fast state cannot leak between samples.

Videos use the official demo_clean configuration with unseen instructions. They are qualitative samples; the separate canonical 100-episode formal evaluation is recorded in metadata.json.

VideoGPUCanonical seedSuccessInstruction
Open video 10100000noOn the table, red, green, and blue blocks are arranged randomly along with three lids. From the current viewpoint, cover the blocks from left to right using the lids, and then uncover them again in the sequence red, green, and blue.
Open video 21100025noOn the table, red, green, and blue blocks are arranged randomly along with three lids. From the current viewpoint, cover the blocks from left to right using the lids, and then uncover them again in the sequence red, green, and blue.
Open video 32100051noOn the table, red, green, and blue blocks are arranged randomly along with three lids. From the current viewpoint, cover the blocks from left to right using the lids, and then uncover them again in the sequence red, green, and blue.
Open video 43100076noOn the table, red, green, and blue blocks are arranged randomly along with three lids. From the current viewpoint, cover the blocks from left to right using the lids, and then uncover them again in the sequence red, green, and blue.

Capture metadata and the formal evaluation summary are in metadata.json.