CoolFace
Datasetpublic

PranayTest/piper-speedup-evals

PiPER speed-up evals Real-robot policy rollouts on the PiPER bimanual cell (plate pick, hand-over, place), run from the operator stack's Policy panel at execution speed multipliers of 1x to 6x. One folder per policy, one sub-folder per run (start time, IST): the three camera clips (top, left-arm, right-arm; re-encoded from the recorded chunks with every frame at its capture time, so they play in real time; clip t = 0 is 1 s before the run start and frame_ts.json lists each… See the full description on the dataset page: https://huggingface.co/datasets/PranayTest/piper-speedup-evals.

sourceHugging Faceupdated 12d agoView on Hugging Face
0likes335downloads
Dataset Card

PiPER speed-up evals

Real-robot policy rollouts on the PiPER bimanual cell (plate pick, hand-over, place), run from the operator stack's Policy panel at execution speed multipliers of 1x to 6x. One folder per policy, one sub-folder per run (start time, IST): the three camera clips (top, left-arm, right-arm; re-encoded from the recorded chunks with every frame at its capture time, so they play in real time; clip t = 0 is 1 s before the run start and frame_ts.json lists each frame's capture time per camera), telemetry.jsonl / telemetry.parquet (every BigQuery signal in the window, including the policy's own policy_command_positions / policy_gripper_command) and manifest.json.

manifest.json carries the run parameters (params.speed is the time-scaling multiplier, 1.0 = the checkpoint's training speed), the gripper command events, the hand-over times (right close → left close → right release, seconds after the start), the peak commanded and measured joint speeds per arm and the stop reason. index.json is the same table as below. Telemetry shows commands and joint feedback, not whether the plate physically transferred.

Runs: 31; hand-over sequences completed: 10. Fastest complete hand-over: act_PhubR_c30_50k_best_reach_v6 at speed 6.0 on 2026-09-10T03:13:42.563000+05:30, right release at 8.9 s.

start (IST)policyspeedre-plan slength sR closeL closeR releasecompleteR cmd/meas peak deg/sstop
02:14:32act_PhubR_50k_hub_prior1.00.504.0no44.7 / 59.3dashboard stop
02:16:08act_PhubR_50k_hub_prior1.00.5071.519.836.139.6yes18.6 / 26.1dashboard stop
02:18:32act_PhubR_50k_hub_prior3.00.5015.511.4no36.8 / 45.7dashboard stop
02:19:30act_PhubR_50k_hub_prior3.00.5032.97.2no46.0 / 104.5dashboard stop
02:20:40act_PhubR_50k_hub_prior3.00.5019.7no30.0 / 32.3dashboard stop
02:21:49act_PhubR_50k_hub_prior1.00.5079.628.9no34.5 / 26.2dashboard stop
02:24:02act_PhubR_50k_hub_prior3.00.5016.110.6no35.9 / 38.6dashboard stop
02:26:28act_PhubR_aug_50k_best_placement_v63.00.502.1no46.4 / 0.03 consecutive chunks rejected
02:27:02act_PhubR_aug_50k_best_placement_v63.00.508.5no44.9 / 0.03 consecutive chunks rejected
02:27:52act_PhubR_c30_50k_best_reach_v61.00.5012.6no11.4 / 0.0dashboard stop
02:28:53act_PhubR_50k_hub_prior1.00.502.1no27.6 / 0.0dashboard stop
02:29:41act_PhubR_aug_50k_best_placement_v63.00.503.8no48.5 / 0.0dashboard stop
02:31:33act_PhubR_aug_50k_best_placement_v63.00.5028.25.813.013.8yes50.2 / 53.3dashboard stop
02:37:15act_PhubR_aug_50k_best_placement_v66.00.5014.84.311.612.9yes77.4 / 91.6dashboard stop
02:41:06act_PhubR_aug_50k_best_placement_v66.00.507.85.0no79.3 / 85.9dashboard stop
02:44:11act_PhubR_aug_50k_best_placement_v66.00.6011.64.8no78.3 / 71.9dashboard stop
02:45:31act_PhubR_aug_50k_best_placement_v63.00.5019.15.012.913.0yes51.9 / 48.9dashboard stop
02:46:51act_PhubR_aug_50k_best_placement_v64.00.5019.55.0no58.1 / 82.4dashboard stop
02:47:52act_PhubR_aug_50k_best_placement_v64.00.5018.55.111.612.3yes52.8 / 65.6dashboard stop
02:51:32act_PhubR_aug_50k_best_placement_v65.00.508.05.0no64.1 / 68.9dashboard stop
02:52:32act_PhubR_aug_50k_best_placement_v64.50.5014.94.311.512.9yes60.2 / 60.6dashboard stop
02:53:11act_PhubR_aug_50k_best_placement_v64.00.5013.44.311.4no100.7 / 60.0dashboard stop
02:54:40act_PhubR_aug_50k_best_placement_v64.00.5026.95.1no55.6 / 59.7dashboard stop
02:56:34act_PhubR_c30_50k_best_reach_v64.00.5012.8no56.4 / 62.3dashboard stop
03:00:26act_PhubR_c30_50k_best_reach_v64.00.1027.111.9no47.2 / 52.7dashboard stop
03:02:00act_PhubR_c30_50k_best_reach_v65.00.1016.74.712.713.3yes67.5 / 62.3dashboard stop
03:05:58act_PhubR_c30_50k_best_reach_v65.00.0514.64.312.112.7yes69.4 / 63.8dashboard stop
03:07:32act_PhubR_c30_50k_best_reach_v65.00.0516.94.1no61.8 / 63.4dashboard stop
03:12:32smolvla_PhubR30_b_20k2.00.105.4no88.9 / 43.1dashboard stop
03:13:42act_PhubR_c30_50k_best_reach_v66.00.0511.33.68.48.9yes73.3 / 92.0dashboard stop
03:16:39act_PhubR_c30_50k_best_reach_v66.00.0512.33.59.29.7yes85.2 / 114.8dashboard stop

Built by episode_pipeline/export_policy_runs.py from BigQuery + GCS; repo PranayTest/piper-speedup-evals.