CoolFace
Datasetpublic

cons909/V1-LeRobot-SO101-Eval-Videos

SO-101 SmolVLA Evaluation Videos — V1 Full evaluation footage and per-trial logs for V1-LeRobot-SO101-Learning-by-Demonstration-SmolVLA — a screwdriver-to-bin pick-and-place task taught to a low-cost SO-101 robotic arm via imitation learning, using LeRobot and the SmolVLA policy. This dataset contains all 150 evaluation trial videos (50 trials x 3 camera configurations) plus their trial-by-trial logs. It's the full record behind the results reported in the GitHub repo's README —… See the full description on the dataset page: https://huggingface.co/datasets/cons909/V1-LeRobot-SO101-Eval-Videos.

sourceHugging Facemitupdated 14d agoView on Hugging Face
1likes1.7kdownloads
Dataset Card

SO-101 SmolVLA Evaluation Videos — V1

Full evaluation footage and per-trial logs for **V1-LeRobot-SO101-Learning-by-Demonstration-SmolVLA** — a screwdriver-to-bin pick-and-place task taught to a low-cost SO-101 robotic arm via imitation learning, using LeRobot and the SmolVLA policy.

This dataset contains all 150 evaluation trial videos (50 trials x 3 camera configurations) plus their trial-by-trial logs. It's the full record behind the results reported in the GitHub repo's README — the repo itself only ships a handful of sample clips to stay lightweight; everything else lives here.

The chart above ("video" / 47.2 — 181) is Hugging Face's own auto-generated preview of clip durations across all 150 videos, in seconds. The spike near 181s is trials that ran out the 180s timeout; everything to the left ended earlier because the arm finished or the operator judged the attempt over. It's a duration summary, not a quality or success indicator.

Watch a video right now

Click any link below to stream it directly in your browser (no download required):

To browse all 150 videos: click the Files tab at the top of this page → open 1cam/, 2cam/, or side_claw/ → videos/ → click any trial_XXX_side.mp4 filename. Each file page has a built-in player (press play) and a Download button. Or use the full per-trial tables below — every row links straight to its video.

Configurations evaluated

FolderConfigurationDemonstrationsCheckpoint stepFull-success rate
1cam/Single left-side camera8020,00010/50 (20%)
2cam/Two side-mounted cameras ("side left + side right")8050,0001/50 (2%)
side_claw/One side camera + one claw-mounted camera8020,00015/50 (30%)

Full methodology (pre-registered protocol, grading rubric, controls) is documented in the GitHub repo's `docs/EVALUATION_PROTOCOL.md`.

Full per-trial results

Every trial, every outcome, every video — click "watch" to stream it directly. This is the same data as the trial_log.csv files, just browsable. For scripts/analysis, use the CSVs directly (1cam/trial_log.csv, 2cam/trial_log.csv, side_claw/trial_log.csv) — same columns, no need to scrape this table.

<details> <summary><b>1 camera (left side) — 50 trials</b></summary>

TrialOutcomeTime (s)Safety clampsVideo
1Timeout (grasped)180.1531watch
2Timeout (no touch)180.0646watch
3Full success72.2397watch
4Timeout (grasped)180.0561watch
5Full success47.2228watch
6Timeout (grasped)180.1492watch
7Full success60.6254watch
8Timeout (grasped)180.0649watch
9Timeout (no touch)180.0549watch
10Timeout (no touch)180.0802watch
11Timeout (no touch)180.2748watch
12Timeout (grasped)180.6976watch
13Full success90.9409watch
14Timeout (grasped)180.1613watch
15Timeout (grasped)180.3694watch
16Timeout (no touch)180.1601watch
17Timeout (no touch)180.1703watch
18Timeout (object OOB)180.11060watch
19Timeout (no touch)180.1653watch
20Timeout (no touch)180.0654watch
21Timeout (no touch)180.0453watch
22Full success80.7232watch
23Reach only161.31232watch
24Full success69.2228watch
25Timeout (grasped)180.11344watch
26Full success93.3482watch
27Timeout (grasped)180.0640watch
28Full success61.9296watch
29Timeout (object OOB)180.1714watch
30Timeout (grasped)180.1442watch
31Timeout (object OOB)180.11204watch
32Timeout (no touch)180.1521watch
33Timeout (grasped)180.1846watch
34Timeout (object OOB)180.0668watch
35Timeout (no touch)180.5764watch
36Timeout (grasped)180.1474watch
37Timeout (no touch)180.1387watch
38Timeout (grasped)180.0429watch
39Timeout (grasped)180.1441watch
40Timeout (object OOB)180.1966watch
41Timeout (object OOB)180.01054watch
42Timeout (no touch)180.0353watch
43Timeout (object OOB)180.1951watch
44Timeout (no touch)180.8481watch
45Full success96.2460watch
46Full success62.9290watch
47Timeout (object OOB)180.0416watch
48Timeout (grasped)180.1744watch
49Timeout (grasped)180.0675watch
50Timeout (grasped)180.0639watch

</details>

<details> <summary><b>2 cameras (side left + side right) — 50 trials</b></summary>

TrialOutcomeTime (s)Safety clampsVideo
1Timeout (no touch)180.2135watch
2Timeout (no touch)180.3134watch
3Timeout (no touch)180.593watch
4Timeout (no touch)180.0514watch
5Timeout (no touch)180.2113watch
6Timeout (no touch)180.1199watch
7Timeout (no touch)180.1312watch
8Timeout (no touch)180.1795watch
9Timeout (no touch)180.1195watch
10Timeout (no touch)180.0115watch
11Timeout (object OOB)180.1243watch
12Timeout (no touch)180.1227watch
13Timeout (grasped)180.1283watch
14Timeout (no touch)180.1176watch
15Timeout (no touch)180.1344watch
16Timeout (object OOB)180.2706watch
17Full success84.7200watch
18Timeout (object OOB)180.11030watch
19Timeout (no touch)180.3346watch
20Timeout (object OOB)180.0427watch
21Timeout (no touch)180.1190watch
22Timeout (grasped)180.0468watch
23Timeout (no touch)180.1201watch
24Timeout (no touch)180.1170watch
25Timeout (no touch)180.11212watch
26Timeout (no touch)180.2492watch
27Timeout (no touch)180.1114watch
28Timeout (no touch)180.0328watch
29Timeout (no touch)180.11179watch
30Timeout (no touch)180.069watch
31Timeout (no touch)180.0168watch
32Timeout (no touch)180.2993watch
33Timeout (no touch)180.0495watch
34Timeout (no touch)180.0139watch
35Timeout (grasped)180.1110watch
36Timeout (no touch)180.01221watch
37Timeout (no touch)180.188watch
38Timeout (no touch)180.0359watch
39Timeout (no touch)180.11194watch
40Timeout (grasped)180.165watch
41Timeout (grasped)180.0168watch
42Timeout (no touch)180.01251watch
43Timeout (no touch)180.051watch
44Timeout (no touch)181.20watch
45Timeout (no touch)180.2628watch
46Timeout (no touch)180.098watch
47Timeout (no touch)180.1142watch
48Timeout (grasped)180.1223watch
49Timeout (no touch)180.1951watch
50Timeout (no touch)180.186watch

</details>

<details> <summary><b>Side + claw — 50 trials</b></summary>

TrialOutcomeTime (s)Safety clampsVideo
1Timeout (succeeded, slow)180.40watch
2Timeout (no touch)180.42watch
3Timeout (succeeded, slow)180.10watch
4Timeout (grasped)180.20watch
5Timeout (no touch)181.11watch
6Timeout (grasped)180.20watch
7Timeout (no touch)180.20watch
8Full success137.90watch
9Grasp only69.30watch
10Full success179.80watch
11Timeout (no touch)181.40watch
12Timeout (succeeded, slow)180.82watch
13Timeout (grasped)180.30watch
15Full success137.47watch
16Timeout (no touch)180.11watch
17Timeout (no touch)180.00watch
18Full success86.25watch
19Full success70.51watch
20Timeout (no touch)180.10watch
21Timeout (no touch)180.20watch
22Timeout (no touch)180.04watch
23Timeout (no touch)180.12watch
24Timeout (no touch)180.64watch
25Full success52.72watch
26Timeout (no touch)180.11watch
27Timeout (no touch)180.13watch
28Timeout (no touch)180.11watch
29Timeout (no touch)180.05watch
30Timeout (no touch)180.32watch
31Timeout (no touch)180.10watch
32Timeout (grasped)180.12watch
33Full success61.11watch
34Timeout (no touch)180.00watch
35Full success53.30watch
36Full success72.11watch
37Timeout (no touch)180.12watch
38Timeout (grasped)180.00watch
39Full success67.72watch
40Timeout (grasped)180.13watch
41Full success61.10watch
42Full success54.60watch
43Timeout (succeeded, slow)180.03watch
44Timeout (no touch)180.13watch
45Timeout (no touch)180.06watch
46Full success62.40watch
47Full success91.94watch
48Timeout (grasped)180.51watch
49Full success66.04watch
50Timeout (no touch)180.16watch
14Timeout (no touch)180.11watch

</details>

outcome is one of 8 pre-registered categories — see `docs/EVALUATION_PROTOCOL.md` for exact definitions. trial_log.csv also logs avg_loop_latency_ms, stop_reason, notes, and checkpoint_step, not shown in the table above.

Privacy note: for both multi-camera configs (2cam, side_claw), only one camera's footage is included per trial — the other camera's feed was dropped before publication to avoid a family member appearing in frame. This does not affect any logged result, only which raw video ships.

Source code

The evaluation harness that produced this data, the Raspberry Pi robot-control servers, and the full methodology/build-log writeup all live in the companion GitHub repo: [cons909/V1-LeRobot-SO101-Learning-by-Demonstration-SmolVLA](https://github.com/cons909/V1-LeRobot-SO101-Learning-by-Demonstration-SmolVLA).

License

MIT, matching the GitHub repo.