CoolFace
Datasetpublic

RoboCOIN/Agilex_Cobot_Magic_connect_block

Agilex_Cobot_Magic_connect_block Dataset Description This dataset uses an extended format based on LeRobot and is fully compatible with LeRobot. Task Preview View Video Directly Overview Total Episodes: 238 Total Frames: 232528 FPS: 30 Dataset Size: 2.20 GB Robot Name: Agilex_Cobot_Magic End-Effector Type: two_finger_gripper Teleoperation Type: Due to some reasons, this dataset temporarily cannot provide the teleoperation type… See the full description on the dataset page: https://huggingface.co/datasets/RoboCOIN/Agilex_Cobot_Magic_connect_block.

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes946downloads
Dataset Card

AgilexCobotMagicconnectblock

Dataset Description

This dataset uses an extended format based on LeRobot and is fully compatible with LeRobot.

Task Preview

<video src="videos/chunk-000/observation.images.camfrontchestrgb/episode000000.mp4" controls width="640"></video>

View Video Directly

Overview

  • —Total Episodes: 238
  • —Total Frames: 232528
  • —FPS: 30
  • —Dataset Size: 2.20 GB
  • —Robot Name: Agilex_Cobot_Magic
  • —End-Effector Type: two_finger_gripper
  • —Teleoperation Type: Due to some reasons, this dataset temporarily cannot provide the teleoperation type information.
  • —Sensors: cam_head_rgb, cam_left_wrist_rgb, cam_right_wrist_rgb, cam_front_chest_rgb
  • —Camera Information: camheadrgb; camleftwristrgb; camrightwristrgb; camfrontchest_rgb
  • —Scene: household->living_room
  • —Objects: table(unknown), square_building_blocks(unknown)
  • —Task Description: According to the building block template in front, assemble the scattered blocks together.

Primary Task Instruction

According to the building block template in front, assemble the scattered blocks together.

Robot Configuration

  • —Robot Name: Agilex_Cobot_Magic
  • —Codebase Version: v2.1
  • —End-Effector Type: two_finger_gripper
  • —Teleoperation Type: Due to some reasons, this dataset temporarily cannot provide the teleoperation type information.

Scene and Objects

Scene Type

household->living_room

Objects

  • —table(unknown)
  • —square_building_blocks(unknown)

Task Descriptions

  • —Standardized Task Description: According to the building block template in front, assemble the scattered blocks together.
  • —Operation Type: Due to some reasons, this dataset temporarily cannot provide the operation type information.
  • —Environment Type: Due to some reasons, this dataset temporarily cannot provide the environment type information.

Sub-Tasks

This dataset includes 297 distinct subtasks:

  1. 1.Put the yellow build block on the right of the green build block (Index: 0)
  2. 2.Put the blue build block on the behind of the green build block (Index: 1)
  3. 3.Put the yellow build block in the center of the table (Index: 2)
  4. 4.Put the blue build block on the right of the yellow build block (Index: 3)
  5. 5.Put the green build block on the red build block (Index: 4)
  6. 6.Put the yellow build block on the behind of the green build block (Index: 5)
  7. 7.Put the orange build block on the right of the yellow build block (Index: 6)
  8. 8.Put the orange build block on the right of the red build block (Index: 7)
  9. 9.Put the orange build block on the right of the blue build block (Index: 8)
  10. 10.Put the green build block on the left of the blue build block (Index: 9)
  11. 11.Put the blue build block on the left of the yellow build block (Index: 10)
  12. 12.Put the yellow build block on the right of the green build block (Index: 11)
  13. 13.Put the orange build block on the front of the blue build block (Index: 12)
  14. 14.Put the orange build block on the left of the green build block (Index: 13)
  15. 15.Put the blue build block on the right of the green build block (Index: 14)
  16. 16.Put the green build block on the behind of the blue build block (Index: 15)
  17. 17.Put the orange build block on the right of the build block (Index: 16)
  18. 18.Put the orange build block on the right of the green build block (Index: 17)
  19. 19.Put the red build block on the behind of the orange build block (Index: 18)
  20. 20.Put the red build block on the front of the yellow build block (Index: 19)
  21. 21.Put the orange build block on the front of the yellow build block (Index: 20)
  22. 22.Put the blue build block on the behind of the green build block (Index: 21)
  23. 23.Put the orange build block in the center of the table (Index: 22)
  24. 24.Put the yellow build block in the center of the table (Index: 23)
  25. 25.Put the green build block on the behind of the yellow build block (Index: 24)
  26. 26.Put the orange build block on the left of the blue build block (Index: 25)
  27. 27.Put the red build block on the right of the blue build block (Index: 26)
  28. 28.Put the yellow build block in the center of the table (Index: 27)
  29. 29.Put the red build block on the behind of the blue build block (Index: 28)
  30. 30.Put the blue build block on the behind of the orange build block (Index: 29)
  31. 31.Put the orange build block on the behind of the green build block (Index: 30)
  32. 32.Put the red build block on the right of the yellow build block (Index: 31)
  33. 33.Put the yellow build block on the front of the orange build block (Index: 32)
  34. 34.Put the blue build block on the right of the green build block (Index: 33)
  35. 35.Put the blue build block on the right of the red build block (Index: 34)
  36. 36.Put the red build block on the behind of the orange build block (Index: 35)
  37. 37.Put the yellow build block on the behind of the green build block (Index: 36)
  38. 38.Put the red build block on the right of the blue build block (Index: 37)
  39. 39.Put the green build block on the behind of the yellow build block (Index: 38)
  40. 40.Put the yellow build block on the behind of the green build block (Index: 39)
  41. 41.Put the orange build block on the behind of the red build block (Index: 40)
  42. 42.Put theyellow build block on the behind of the blue build block (Index: 41)
  43. 43.Put the green build block on the behind of the yellow build block (Index: 42)
  44. 44.Put the red build block on the right of the orange build block (Index: 43)
  45. 45.Put the yellow build block on the right of the red build block (Index: 44)
  46. 46.Put the blue build block on the right of the orange build block (Index: 45)
  47. 47.Put the green build block on the right of the yellow build block (Index: 46)
  48. 48.Put the orange build block in the center of the table (Index: 47)
  49. 49.Put the green build block on the orange build block (Index: 48)
  50. 50.Put the yellow build block on the right of the blue build block (Index: 49)
  51. 51.Put the green build block on the right of the red build block (Index: 50)
  52. 52.Put the green build block on the blue build block (Index: 51)
  53. 53.Put the green build block on the right of the orange build block (Index: 52)
  54. 54.Put the blue build block in the center of the table (Index: 53)
  55. 55.Put the orange build block on the behind of the green build block (Index: 54)
  56. 56.Put the red build block on the right of the yellow build block (Index: 55)
  57. 57.Put the blue build block on the behind of the green build block (Index: 56)
  58. 58.Put the orange build block on the right of the blue build block (Index: 57)
  59. 59.Put the yellow build block on the behind of the orange build block (Index: 58)
  60. 60.Put the orange build block in the center of the table (Index: 59)
  61. 61.Put the blue build block on the right of the yellow build block (Index: 60)
  62. 62.Put the orange build block on the behind of the yellow build block (Index: 61)
  63. 63.Put the yellow build block on the behind of the green build block (Index: 62)
  64. 64.Put the blue build block on the front of the orange build block (Index: 63)
  65. 65.Put the green build block on the behind of the red build block (Index: 64)
  66. 66.Put the green build block in the center of the table (Index: 65)
  67. 67.Put the green build block on the right of the yellow build block (Index: 66)
  68. 68.Put the red build block on the right of the blue build block (Index: 67)
  69. 69.Put the red build block on the behind of the green build block (Index: 68)
  70. 70.Put the blue build block on the behind of the orange build block (Index: 69)
  71. 71.Put the yellow build block on the right of the red build block (Index: 70)
  72. 72.Put the blue build block in the center of the table (Index: 71)
  73. 73.Put the red build block on the behind of the yellow build block (Index: 72)
  74. 74.Put the yellow build block on the right of the red build block (Index: 73)
  75. 75.Put the green build block on the right of the orange build block (Index: 74)
  76. 76.Put the red build block on the blue build block (Index: 75)
  77. 77.Put the orange build block on the left of the yellow build block (Index: 76)
  78. 78.Put the green build block on the right of the red build block (Index: 77)
  79. 79.Put the red build block on the left of the orange build block (Index: 78)
  80. 80.Put the orange build block on the right of the blue build block (Index: 79)
  81. 81.Put the red build block on the right of the orange build block (Index: 80)
  82. 82.Put the orange build block on the behind of the yellow build block (Index: 81)
  83. 83.Put the yellow build block in the center of the table (Index: 82)
  84. 84.Put the yellow build block on the behind of the red build block (Index: 83)
  85. 85.Put the yellow build block on the behind of the blue build block (Index: 84)
  86. 86.Put the orange build block on the behind of the red build block (Index: 85)
  87. 87.Put the yellow build block in the center of the table (Index: 86)
  88. 88.Put the green build block on the right of the blue build block (Index: 87)
  89. 89.Put the orange build block on the right of the yellow build block (Index: 88)
  90. 90.Put the blue build block on the right of the yellow build block (Index: 89)
  91. 91.Put the red build block on the right of the green build block (Index: 90)
  92. 92.Put the orange build block on the behind of the yellow build block (Index: 91)
  93. 93.Put the yellow build block on the blue build block (Index: 92)
  94. 94.Put the red build block on the right of the orange build block (Index: 93)
  95. 95.Put the bluebuild block on the right of the yellow build block (Index: 94)
  96. 96.Put the red build block in the center of the table (Index: 95)
  97. 97.Put the red build block on the blue build block (Index: 96)
  98. 98.Put the orange build block on the right of the blue build block (Index: 97)
  99. 99.Put the blue build block on the behind of the orange build block (Index: 98)
  100. 100.Put the yellow build block on the right of the red build block (Index: 99)
  101. 101. Put the yellow build block on the behind of the green build block (Index: 100)
  102. 102.Put the yellow build block on the right of the orange build block (Index: 101)
  103. 103.Put the orange build block on the behind of the blue build block (Index: 102)
  104. 104.Put the orange build block on the right of the red build block (Index: 103)
  105. 105.Put the green build block on the behind of the orange build block (Index: 104)
  106. 106.Put the blue build block on the behind of the yellow build block (Index: 105)
  107. 107.Put the yellow build block on the right of the orange build block (Index: 106)
  108. 108.Put the green build block on the behind of the yellow build block (Index: 107)
  109. 109.Put the green build block on the right of the red build block (Index: 108)
  110. 110.Put the red build block on the front of the blue build block (Index: 109)
  111. 111.Put the red build block on the behind of the green' build block (Index: 110)
  112. 112.Put the red build block on the behind of the orange build block (Index: 111)
  113. 113.Put the red build block on the left of the green build block (Index: 112)
  114. 114.Put the green build block on the behind of the yellow build block (Index: 113)
  115. 115.Put blue the build block on the right of the red build block (Index: 114)
  116. 116.Put the green build block on the orange build block (Index: 115)
  117. 117.Put the orange build block on the right of the red build block (Index: 116)
  118. 118.Put the blue build block on the right of the green build block (Index: 117)
  119. 119.Put the yellow build block on the right of the blue build block (Index: 118)
  120. 120.Put the orange build block on the behind of the blue build block (Index: 119)
  121. 121. Put the yellow build block in the center of the table (Index: 120)
  122. 122.Put the yellow build block on the right of the green build block (Index: 121)
  123. 123.Put the green build block on the behind of the yellow build block (Index: 122)
  124. 124.Put the blue build block in the center of the table (Index: 123)
  125. 125.Put the orange build block in the center of the table (Index: 124)
  126. 126.Put the yellow build block on the right of the green build block (Index: 125)
  127. 127.Put the red build block on the right of the yellow build block (Index: 126)
  128. 128.Put the yellow build block on the behind of the red build block (Index: 127)
  129. 129.Put the red build block on the behind of the green build block (Index: 128)
  130. 130.Put the green build block on the behind of the blue build block (Index: 129)
  131. 131.Put the green build block on the behind of the orange build block (Index: 130)
  132. 132.Put the blue build block on the right of the green build block (Index: 131)
  133. 133.Put the green build block in the center of the table (Index: 132)
  134. 134.Put the green build block on the behind of the blue build block (Index: 133)
  135. 135.Put the green build block on the left of the orange build block (Index: 134)
  136. 136.Put the red build block on the behind of the yellow build block (Index: 135)
  137. 137.Put the yellow build block on the right of the green build block (Index: 136)
  138. 138.Put the blue build block on the behind of the red build block (Index: 137)
  139. 139.Put the orange build block on the behind of the red build block (Index: 138)
  140. 140.Put the blue build block on the behind of the green build block (Index: 139)
  141. 141.Put the yellow build block on the blue build block (Index: 140)
  142. 142.Put the red build block on the front of the green build block (Index: 141)
  143. 143.Put the red build block on the left of the ornage build block (Index: 142)
  144. 144.Put the green build block in the center of the table (Index: 143)
  145. 145.Put the red build block on the right of the green build block (Index: 144)
  146. 146.Put the yellow build block on the right of the orange build block (Index: 145)
  147. 147.Put the yellow build block on the right of the blue build block (Index: 146)
  148. 148.Put the XX build block on the XX build block (Index: 147)
  149. 149.Put the yellow build block in the center of the table (Index: 148)
  150. 150.Put the orange build block on the green build block (Index: 149)
  151. 151.End (Index: 150)
  152. 152.Put the blue build block on the right of the red build block (Index: 151)
  153. 153.Put the green build block on the right of the orange build block (Index: 152)
  154. 154.Put the greem build block on the behind of the blue build block (Index: 153)
  155. 155.Put the left build block on the left of the green build block (Index: 154)
  156. 156.Put the green build block on the right of the orange build block (Index: 155)
  157. 157.Put the red build block on the left of the blue build block (Index: 156)
  158. 158.Put the blue build block on the right of the orange build block (Index: 157)
  159. 159.Put the yellow build block on the behind of the orange build block (Index: 158)
  160. 160.Put the green build block on the behind of the blue build block (Index: 159)
  161. 161.Put the yellow build block on the right of the orange build block (Index: 160)
  162. 162.Put the blue build block on the behind of the orange build block (Index: 161)
  163. 163.Put the red build block on the front of the green build block (Index: 162)
  164. 164.Put the red build block on the front of the yellow build block (Index: 163)
  165. 165.Put the yellow build block on the behind of the blue build block (Index: 164)
  166. 166.Put the blue build block on the orange build block (Index: 165)
  167. 167.Put the green build block in the center of the table (Index: 166)
  168. 168.Put the orange build block on the front of the blue build block (Index: 167)
  169. 169.Put the blue build block on the right of the yellow build block (Index: 168)
  170. 170.Put the blue build block on the left of the yellow build block (Index: 169)
  171. 171.Put the orange build block on the right of the yellow build block (Index: 170)
  172. 172.Put the orange build block on the left of the red build block (Index: 171)
  173. 173.Put the green build block in the center of the table (Index: 172)
  174. 174.Put the red build block on the right of the blue build block (Index: 173)
  175. 175.Put the blue build block on the right of the yellow build block (Index: 174)
  176. 176.Put the green build block on the right of the orange build block (Index: 175)
  177. 177.Put the blue build block in the center of the table (Index: 176)
  178. 178.Put the green build block on the right of the red build block (Index: 177)
  179. 179.Put the green build block on the right of the blue build block (Index: 178)
  180. 180.Put the yellow build block in the center of the table (Index: 179)
  181. 181.Abnormal (Index: 180)
  182. 182.Put the red build block on the behind of the orange build block (Index: 181)
  183. 183.Put the red build block on the yellow build block (Index: 182)
  184. 184.Put the orange build block on the right of the yellow build block (Index: 183)
  185. 185.Put the red build block on the right of the yellow build block (Index: 184)
  186. 186.Put the orange build block on the right of the blue build block (Index: 185)
  187. 187.Put the orange build block on the orange build block (Index: 186)
  188. 188.Put the blue build block on the behind of the red build block (Index: 187)
  189. 189.Put the yellow build block on the right of the blue build block (Index: 188)
  190. 190.Put the yellow build block on the behind of the green build block (Index: 189)
  191. 191.Put the yellow build block on the left of the blue build block (Index: 190)
  192. 192.Put the yellow build block on the right of the orange build block (Index: 191)
  193. 193.Put the yellow build block on the blue build block (Index: 192)
  194. 194.Put the yellow build block on the behind of the blue build block (Index: 193)
  195. 195.Put the green build block on the right of the blue build block (Index: 194)
  196. 196.Put the orange build block on the right of the yellow build block (Index: 195)
  197. 197.Put the red build block on the behind of the green build block (Index: 196)
  198. 198.Put the red build block in the center of the table (Index: 197)
  199. 199.Put the yellow build block on the behind of the blue build block (Index: 198)
  200. 200.Put the green build block on the behind of the orange build block (Index: 199)
  201. 201.Put the yellow build block on the behind of the red build block (Index: 200)
  202. 202.Put the green build block on the right of the yellow build block (Index: 201)
  203. 203.Put the green build block on the red build block (Index: 202)
  204. 204.Put the blue build block on the right of the orange build block (Index: 203)
  205. 205.Put the red build block on the behind of the orange build block (Index: 204)
  206. 206.Put the red build block in the center of the table (Index: 205)
  207. 207.Put the red build block in the center of the table (Index: 206)
  208. 208.Put the green build block on the right of the orange build block (Index: 207)
  209. 209.Put the green build block on the front of the blue build block (Index: 208)
  210. 210.Put the yellow build block on the behind of the orange build block (Index: 209)
  211. 211.Put the yellow build block on the behind of the blue build block (Index: 210)
  212. 212.Put the green build block on the blue build block (Index: 211)
  213. 213.Put the blue build block on the right of the yellow build block (Index: 212)
  214. 214.Put the blue build block on the right of the orange build block (Index: 213)
  215. 215.Put the orange build block on the left of the red build block (Index: 214)
  216. 216.Put the orange build block on the right of the blue build block (Index: 215)
  217. 217.Put the blue build block on the front of the green build block (Index: 216)
  218. 218.Put the yellow build block on the orange build block (Index: 217)
  219. 219.Put the yellow build block on the front of the red build block (Index: 218)
  220. 220.Put the orange build block on the behind of the red build block (Index: 219)
  221. 221.Put the yellow build block on the behind of the green build block (Index: 220)
  222. 222.Put the blue build block on the right of orange the build block (Index: 221)
  223. 223.Put the red build block on the right of the blue build block (Index: 222)
  224. 224.Put the green build block on the behind of the orange build block (Index: 223)
  225. 225.Put the green build block on the behind of the yellow build block (Index: 224)
  226. 226.Put the yellow build block on the right of the green build block (Index: 225)
  227. 227.Put the orange build block on the right of the green build block (Index: 226)
  228. 228.Put the orange build block on the right of the yellow build block (Index: 227)
  229. 229.Put the red build block on the green build block (Index: 228)
  230. 230.Put the red build block on the right of the blue build block (Index: 229)
  231. 231.Put the blue build block on the behind of the green build block (Index: 230)
  232. 232.Put the orange build block on the right of the red build block (Index: 231)
  233. 233.Put the blue build block on the red build block (Index: 232)
  234. 234.Put the orange build block on the right of the blue build block (Index: 233)
  235. 235.Put the orange build block on the left of the yellow build block (Index: 234)
  236. 236.Put the right build block on the right of the yellow build block (Index: 235)
  237. 237.Put the green build block on the right of the red build block (Index: 236)
  238. 238.Put the orange build block on the right of the green build block (Index: 237)
  239. 239.Put the blue build block in the center of the table (Index: 238)
  240. 240.Put the orange build block on the behind of the yellow build block (Index: 239)
  241. 241.Put the orange build block on the right of the blue build block (Index: 240)
  242. 242.Put the orange build block on the behind of the blue build block (Index: 241)
  243. 243.Put the red build block on the behind of the yellow build block (Index: 242)
  244. 244.Put the ornage build block on the behind of the green build block (Index: 243)
  245. 245.Put the blue build block on the left of the yellow build block (Index: 244)
  246. 246.Put the green build block on the front of the blue build block (Index: 245)
  247. 247.Put the green build block on the behind of the red build block (Index: 246)
  248. 248.Put the green build block on the right of the orange build block (Index: 247)
  249. 249.Put the green build block on the right of the orange build block (Index: 248)
  250. 250.Put the yellow build block on the behind of the red build block (Index: 249)
  251. 251.Put the blue build block on the green build block (Index: 250)
  252. 252.Put the blue build block on the right of the orange build block (Index: 251)
  253. 253.Put the orange build block on the right of the green build block (Index: 252)
  254. 254.Put the orange build block on the behind of the yellow build block (Index: 253)
  255. 255.Put the green build block in the center of the table (Index: 254)
  256. 256.Put the blue build block on the behind of the orange build block (Index: 255)
  257. 257.Put the green build block on the left of the orange build block (Index: 256)
  258. 258.Put the green build block on the right of the yellow build block (Index: 257)
  259. 259.Put the green build block on the left of the blue build block (Index: 258)
  260. 260.Put the orange build block on the right of the green build block (Index: 259)
  261. 261.Put the green build block on the orange build block (Index: 260)
  262. 262.Put the blue build block on the behind of the green build block (Index: 261)
  263. 263.Put the yellow build block on the behind of the red build block (Index: 262)
  264. 264.Put the orange build block on the green build block (Index: 263)
  265. 265.Put the red build block on the behind of the blue build block (Index: 264)
  266. 266.Put the blue build block on the right of the orange build block (Index: 265)
  267. 267.move the build block to the center of the table (Index: 266)
  268. 268.Put the green build block on the right of the red build block (Index: 267)
  269. 269.Put the red build block on the behind of the green build block (Index: 268)
  270. 270.Put the red build block on the behind of the blue build block (Index: 269)
  271. 271.Put the yellow build block on the behind of the orange build block (Index: 270)
  272. 272.Put the red build block on the right of the orange build block (Index: 271)
  273. 273.Put the green build block on the right of the yellow build block (Index: 272)
  274. 274.Put the red build block on the right of the yellow build block (Index: 273)
  275. 275.Put the red build block in the center of the table (Index: 274)
  276. 276.Put the red build block on the right of the blue build block (Index: 275)
  277. 277.Put the yellow build block on the behind of the green build block (Index: 276)
  278. 278.Put the red build block on the right of the orange build block (Index: 277)
  279. 279.Put the blue build block on the right of the orange build block (Index: 278)
  280. 280.Put the orange build block on the behind of the green build block (Index: 279)
  281. 281.Put the blue build block on the front of the green build block (Index: 280)
  282. 282.Put the ornage build block on the behind of the blue build block (Index: 281)
  283. 283.Put the yellow build block on the behind of the orange build block (Index: 282)
  284. 284.Put the green build block on the behind of the blue build block (Index: 283)
  285. 285.Put the green build block on the left of the blue build block (Index: 284)
  286. 286.Put the blue build block in the center of the table (Index: 285)
  287. 287.Put the green build block on the right of the yellow build block (Index: 286)
  288. 288.Put the yellow build block on the behind of the blue build block (Index: 287)
  289. 289.Put the green build block on the right of the orange build block (Index: 288)
  290. 290.Put the green build block on the blue build block (Index: 289)
  291. 291.Put the orange build block on the behind of the blue build block (Index: 290)
  292. 292.Put the red build block on the behind of the yellow build block (Index: 291)
  293. 293.Put the orange build block on the blue build block (Index: 292)
  294. 294.Put the green build block on the right of the orange build block (Index: 293)
  295. 295.Put the orange build block on the left of the red build block (Index: 294)
  296. 296.Put the green build block in the center of the table (Index: 295)
  297. 297.null (Index: 296)

Atomic Actions

  • —grasp
  • —lift
  • —lower

Hardware and Sensors

Sensors

  • —cam_head_rgb
  • —cam_left_wrist_rgb
  • —cam_right_wrist_rgb
  • —cam_front_chest_rgb

Camera Information

  • —cam_head_rgb: dtype=video, shape=480x640x3, resolution=640x480, codec=av1, pix_fmt=yuv420p
  • —cam_left_wrist_rgb: dtype=video, shape=480x640x3, resolution=640x480, codec=av1, pix_fmt=yuv420p
  • —cam_right_wrist_rgb: dtype=video, shape=480x640x3, resolution=640x480, codec=av1, pix_fmt=yuv420p
  • —cam_front_chest_rgb: dtype=video, shape=480x640x3, resolution=640x480, codec=av1, pix_fmt=yuv420p

Coordinate System

  • —Definition: right-hand-frame

Dimensions & Units

  • —Joint Rotation: radian
  • —End-Effector Rotation: radian
  • —End-Effector Translation: meter

Dataset Statistics

MetricValue
Total Episodes238
Total Frames232528
Total Tasks297
Total Videos952
Total Chunks1
Chunk Size1000
FPS30
State Dimensions26
Action Dimensions26
Camera Views4
Dataset Size2.20 GB

Data Splits

The dataset is organized into the following splits:

  • —Training: Episodes 0:237

Dataset Structure

This dataset follows the LeRobot format and contains the following components:

Data Files

  • —Videos: Compressed video files containing RGB camera observations
  • —State Data: Robot joint positions, velocities, and other state information
  • —Action Data: Robot action commands and trajectories
  • —Metadata: Episode metadata, timestamps, and annotations

File Organization

  • —Data Path Pattern: data/chunk-{id}/episode_{id}.parquet
  • —Video Path Pattern: videos/chunk-{id}/observation.images.cam_left_wrist_rgb/episode_{id}.mp{id}
  • —Chunking: Data is organized into 1 chunk(s) of size 1000

Data Structure (Tree)

Agilex_Cobot_Magic_connect_block_qced_hardlink/
|-- annotations
|   |-- eef_acc_mag_annotation.jsonl
|   |-- eef_direction_annotation.jsonl
|   |-- eef_velocity_annotation.jsonl
|   |-- gripper_activity_annotation.jsonl
|   |-- gripper_mode_annotation.jsonl
|   |-- scene_annotations.jsonl
|   `-- subtask_annotations.jsonl
|-- data
|   `-- chunk-000
|       |-- episode_000000.parquet
|       |-- episode_000001.parquet
|       |-- episode_000002.parquet
|       |-- episode_000003.parquet
|       |-- episode_000004.parquet
|       |-- episode_000005.parquet
|       |-- episode_000006.parquet
|       |-- episode_000007.parquet
|       |-- episode_000008.parquet
|       |-- episode_000009.parquet
|       |-- episode_000010.parquet
|       `-- episode_000011.parquet
|       `-- ... (226 more entries)
|-- meta
|   |-- episodes.jsonl
|   |-- episodes_stats.jsonl
|   |-- info.json
|   `-- tasks.jsonl
|-- videos
|   `-- chunk-000
|       |-- observation.images.cam_front_chest_rgb
|       |-- observation.images.cam_head_rgb
|       |-- observation.images.cam_left_wrist_rgb
|       `-- observation.images.cam_right_wrist_rgb
|-- info.yaml
`-- README.md

Camera Views

This dataset includes 4 camera views: cam_head_rgb, cam_left_wrist_rgb, cam_right_wrist_rgb, cam_front_chest_rgb.

Features (Full YAML)

yaml
observation.images.cam_head_rgb:
  dtype: video
  shape:
  - 480
  - 640
  - 3
  names:
  - height
  - width
  - channels
  info:
    video.height: 480
    video.width: 640
    video.codec: av1
    video.pix_fmt: yuv420p
    video.is_depth_map: false
    video.fps: 30
    video.channels: 3
    has_audio: false
observation.images.cam_left_wrist_rgb:
  dtype: video
  shape:
  - 480
  - 640
  - 3
  names:
  - height
  - width
  - channels
  info:
    video.height: 480
    video.width: 640
    video.codec: av1
    video.pix_fmt: yuv420p
    video.is_depth_map: false
    video.fps: 30
    video.channels: 3
    has_audio: false
observation.images.cam_right_wrist_rgb:
  dtype: video
  shape:
  - 480
  - 640
  - 3
  names:
  - height
  - width
  - channels
  info:
    video.height: 480
    video.width: 640
    video.codec: av1
    video.pix_fmt: yuv420p
    video.is_depth_map: false
    video.fps: 30
    video.channels: 3
    has_audio: false
observation.images.cam_front_chest_rgb:
  dtype: video
  shape:
  - 480
  - 640
  - 3
  names:
  - height
  - width
  - channels
  info:
    video.height: 480
    video.width: 640
    video.codec: av1
    video.pix_fmt: yuv420p
    video.is_depth_map: false
    video.fps: 30
    video.channels: 3
    has_audio: false
observation.state:
  dtype: float32
  shape:
  - 26
  names:
  - left_arm_joint_1_rad
  - left_arm_joint_2_rad
  - left_arm_joint_3_rad
  - left_arm_joint_4_rad
  - left_arm_joint_5_rad
  - left_arm_joint_6_rad
  - left_gripper_open
  - left_eef_pos_x_m
  - left_eef_pos_y_m
  - left_eef_pos_z_m
  - left_eef_rot_euler_x_rad
  - left_eef_rot_euler_y_rad
  - left_eef_rot_euler_z_rad
  - right_arm_joint_1_rad
  - right_arm_joint_2_rad
  - right_arm_joint_3_rad
  - right_arm_joint_4_rad
  - right_arm_joint_5_rad
  - right_arm_joint_6_rad
  - right_gripper_open
  - right_eef_pos_x_m
  - right_eef_pos_y_m
  - right_eef_pos_z_m
  - right_eef_rot_euler_x_rad
  - right_eef_rot_euler_y_rad
  - right_eef_rot_euler_z_rad
action:
  dtype: float32
  shape:
  - 26
  names:
  - left_arm_joint_1_rad
  - left_arm_joint_2_rad
  - left_arm_joint_3_rad
  - left_arm_joint_4_rad
  - left_arm_joint_5_rad
  - left_arm_joint_6_rad
  - left_gripper_open
  - left_eef_pos_x_m
  - left_eef_pos_y_m
  - left_eef_pos_z_m
  - left_eef_rot_euler_x_rad
  - left_eef_rot_euler_y_rad
  - left_eef_rot_euler_z_rad
  - right_arm_joint_1_rad
  - right_arm_joint_2_rad
  - right_arm_joint_3_rad
  - right_arm_joint_4_rad
  - right_arm_joint_5_rad
  - right_arm_joint_6_rad
  - right_gripper_open
  - right_eef_pos_x_m
  - right_eef_pos_y_m
  - right_eef_pos_z_m
  - right_eef_rot_euler_x_rad
  - right_eef_rot_euler_y_rad
  - right_eef_rot_euler_z_rad
timestamp:
  dtype: float32
  shape:
  - 1
  names: null
frame_index:
  dtype: int64
  shape:
  - 1
  names: null
episode_index:
  dtype: int64
  shape:
  - 1
  names: null
index:
  dtype: int64
  shape:
  - 1
  names: null
task_index:
  dtype: int64
  shape:
  - 1
  names: null
subtask_annotation:
  names: null
  dtype: int32
  shape:
  - 5
scene_annotation:
  names: null
  dtype: int32
  shape:
  - 1
eef_sim_pose_state:
  names:
  - left_eef_pos_x
  - left_eef_pos_y
  - left_eef_pos_z
  - left_eef_rot_x
  - left_eef_rot_y
  - left_eef_rot_z
  - right_eef_pos_x
  - right_eef_pos_y
  - right_eef_pos_z
  - right_eef_rot_x
  - right_eef_rot_y
  - right_eef_rot_z
  dtype: float32
  shape:
  - 12
eef_sim_pose_action:
  names:
  - left_eef_pos_x
  - left_eef_pos_y
  - left_eef_pos_z
  - left_eef_rot_x
  - left_eef_rot_y
  - left_eef_rot_z
  - right_eef_pos_x
  - right_eef_pos_y
  - right_eef_pos_z
  - right_eef_rot_x
  - right_eef_rot_y
  - right_eef_rot_z
  dtype: float32
  shape:
  - 12
eef_direction_state:
  names:
  - left_eef_direction
  - right_eef_direction
  dtype: int32
  shape:
  - 2
eef_direction_action:
  names:
  - left_eef_direction
  - right_eef_direction
  dtype: int32
  shape:
  - 2
eef_velocity_state:
  names:
  - left_eef_velocity
  - right_eef_velocity
  dtype: int32
  shape:
  - 2
eef_velocity_action:
  names:
  - left_eef_velocity
  - right_eef_velocity
  dtype: int32
  shape:
  - 2
eef_acc_mag_state:
  names:
  - left_eef_acc_mag
  - right_eef_acc_mag
  dtype: int32
  shape:
  - 2
eef_acc_mag_action:
  names:
  - left_eef_acc_mag
  - right_eef_acc_mag
  dtype: int32
  shape:
  - 2
gripper_mode_state:
  names:
  - left_gripper_mode
  - right_gripper_mode
  dtype: int32
  shape:
  - 2
gripper_mode_action:
  names:
  - left_gripper_mode
  - right_gripper_mode
  dtype: int32
  shape:
  - 2
gripper_activity_state:
  names:
  - left_gripper_activity
  - right_gripper_activity
  dtype: int32
  shape:
  - 2
gripper_activity_action:
  names:
  - left_gripper_activity
  - right_gripper_activity
  dtype: int32
  shape:
  - 2
gripper_open_scale_state:
  names:
  - left_gripper_open_scale
  - right_gripper_open_scale
  dtype: float32
  shape:
  - 2
gripper_open_scale_action:
  names:
  - left_gripper_open_scale
  - right_gripper_open_scale
  dtype: float32
  shape:
  - 2

Available Annotations

This dataset includes rich annotations to support diverse learning approaches:

  • —eef_acc_mag_annotation.jsonl
  • —eef_direction_annotation.jsonl
  • —eef_velocity_annotation.jsonl
  • —gripper_activity_annotation.jsonl
  • —gripper_mode_annotation.jsonl
  • —scene_annotations.jsonl
  • —subtask_annotations.jsonl

Dataset Tags

  • —RoboCOIN
  • —LeRobot

Authors

Contributors

This dataset is contributed by:-RoboCOIN Team at Beijing Academy of Artificial Intelligence (BAAI)

Annotators

No annotator information available.

Links

Contact and Support

For questions, issues, or feedback regarding this dataset, please contact us.

Support

For technical support, please open an issue on our GitHub repository.

License

apache-2.0

Citation

If you use this dataset in your research, please cite:

bibtex
@article{robocoin,
  title={RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulation},
  author={Shihan Wu, Xuecheng Liu, Shaoxuan Xie, Pengwei Wang, Xinghang Li, Bowen Yang, Zhe Li, Kai Zhu, Hongyu Wu, Yiheng Liu, Zhaoye Long, Yue Wang, Chong Liu, Dihan Wang, Ziqiang Ni, Xiang Yang, You Liu, Ruoxuan Feng, Runtian Xu, Lei Zhang, Denghang Huang, Chenghao Jin, Anlan Yin, Xinlong Wang, Zhenguo Sun, Junkai Zhao, Mengfei Du, Mingyu Cao, Xiansheng Chen, Hongyang Cheng, Xiaojie Zhang, Yankai Fu, Ning Chen, Cheng Chi, Sixiang Chen, Huaihai Lyu, Xiaoshuai Hao, Yequan Wang, Bo Lei, Dong Liu, Xi Yang, Yance Jiao, Tengfei Pan, Yunyan Zhang, Songjing Wang, Ziqian Zhang, Xu Liu, Ji Zhang, Caowei Meng, Zhizheng Zhang, Jiyang Gao, Song Wang, Xiaokun Leng, Zhiqiang Xie, Zhenzhen Zhou, Peng Huang, Wu Yang, Yandong Guo, Yichao Zhu, Suibing Zheng, Hao Cheng, Xinmin Ding, Yang Yue, Huanqian Wang, Chi Chen, Jingrui Pang, YuXi Qian, Haoran Geng, Lianli Gao, Haiyuan Li, Bin Fang, Gao Huang, Yaodong Yang, Hao Dong, He Wang, Hang Zhao, Yadong Mu, Di Hu, Hao Zhao, Tiejun Huang, Shanghang Zhang, Yonghua Lin, Zhongyuan Wang and Guocai Yao},
  journal={arXiv preprint arXiv:2511.17441},
  url = {https://arxiv.org/abs/2511.17441},
  year={2025},
  }

Additional References

If you use this dataset, please also consider citing: LeRobot Framework: https://github.com/huggingface/lerobot

Version Information

Initial Release