datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
video-SALMONN_2_testset
video-SALMONN 2 Benchmark
Generate the caption corresponding to the video and the audio with video_salmonn2_test.json
Organize your results in the format like the following example:
[
{
"id": ["0.mp4"],
"pred": "Generated Caption"
}
]
Replace res_file in eval.py with your result file.
Run python3 eval.pyvideo-SALMONN_2_testset
video-SALMONN 2 Benchmark
Github Link
Paper Link
Generate the caption corresponding to the video and the audio with video_salmonn2_test.json
Organize your results in the format like the following example:
[
{
"id": ["0.mp4"],
"pred": "Generated Caption"
}
]
Replace res_file in eval.py with your result file.
Run python3 eval.py
MCABSA_testsetlibero_rollouts_tests_100epFakeVV_testset_video2024.09.14_AGH_manual_Temperature_tests_20-55_Degrees
Temperature tests (20-55 Degrees)
Dataset author: Oğuzhan Berke Özdil
What was measured?
Methods
Type of needle: Quincke 22G 9cm
Needle Was attached with 3d printed needle attachment directly in front of the sound hole of the microphone
Type of microphone:
How the measurements were taken: manual
Phantoms
thickness of foams : 3 cm
Foam is the same as we used in Magdeburg foam phantom.
Foams were soaked in warm/hot water to create different… See the full description on the dataset page: https://huggingface.co/datasets/VibroNav/2024.09.14_AGH_manual_Temperature_tests_20-55_Degrees.test-single-taskThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100_follower",
"total_episodes": 2,
"total_frames": 600,
"total_tasks": 1,
"total_videos": 8,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:2"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/kevin510/test-single-task.test_shortsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "aloha",
"total_episodes": 50,
"total_frames": 47037,
"total_tasks": 1,
"total_videos": 150,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/HuaihaiLyu/test_shorts.testset
testset
This dataset was generated using a phospho starter pack.
This dataset contains a series of episodes recorded with a robot and multiple cameras. It can be directly used to train a policy using imitation learning. It's compatible with LeRobot and RLDS.
Minimax-H3-sampler_scheduler-tests
Test Configuration
Parameter
Value
Model
Minimax H3 FL2VA
LoRA
Turbo LoRA (LightX2V, converted by Kijai)
Steps
6
LoRA Strength
0.75
Optimizations
Sage Attention Patch + Mem Eff Sage Attention Patch
Tested Combinations
The following sampler + scheduler combinations were evaluated:
Sampler
Schedulers
dpmpp_2s_ancestral
normal
er_sde
beta, sgm_uniform, simple
euler_ancestral
beta, beta57, simple
euler_ancestral_cfg_pp
beta… See the full description on the dataset page: https://huggingface.co/datasets/supermind/Minimax-H3-sampler_scheduler-tests.data_testssss6This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 30,
"total_frames": 13714,
"total_tasks": 1,
"total_videos": 60,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lqzjbs/data_testssss6.test-slam-axis-fixThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "grabette",
"total_episodes": 3,
"total_frames": 1058,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 50,
"splits": {
"train": "0:3"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/simheo/test-slam-axis-fix.test_smol_dataset_1isaacsim_merge_testset_no_depthThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "AgileX Piper",
"total_episodes": 5,
"total_frames": 1597,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/JHaeringer/isaacsim_merge_testset_no_depth.H3-Dual-Sampling-Quality-Teststest_sac_improvementThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": null,
"total_episodes": 30,
"total_frames": 532,
"total_tasks": 1,
"total_videos": 60,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lilkm/test_sac_improvement.CHAI_testset
Building a Precise Video Language with Human-AI Oversight
This repository contains the evaluation data for CHAI (Critique-based Human–AI), an oversight framework for precise video captioning.
Paper | Project Page | GitHub
Overview
CHAI is an oversight framework that pairs trained human experts with model-generated pre-captions. Experts provide correctional critiques that guide revisions into improved post-captions. This dataset includes open benchmarks and evaluation… See the full description on the dataset page: https://huggingface.co/datasets/chancharikm/CHAI_testset.test-syncThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "grabette",
"total_episodes": 5,
"total_frames": 805,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 50,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/glannuzel/test-sync.test-synchroThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "grabette",
"total_episodes": 5,
"total_frames": 1251,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 50,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/glannuzel/test-synchro.test-setup-baselineThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 32,
"total_frames": 4399,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:32"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/rhecker/test-setup-baseline.test_stellartest_stack_cakeThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "franka",
"total_episodes": 2,
"total_frames": 720,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 15,
"splits": {
"train": "0:2"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/danielsanjosepro/test_stack_cake.Test_So101ffw_sg2_rev1_TESTSET123123This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "aiworker",
"total_episodes": 5,
"total_frames": 1233,
"total_tasks": 1,
"total_videos": 15,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Dongkkka/ffw_sg2_rev1_TESTSET123123.wisa_i2v_testsuit
WISA I2V Test Suite (121 frames @ 24 fps)
A human-free physics video test set of 5,638 clips across 11 physical-phenomenon
categories, re-cut to 121 frames @ 24 fps at 832x480, paired with the first frame
of every clip (PNG) so the set can be used directly as an image-to-video (I2V) benchmark.
Each clip ships with a long-form English prompt describing the scene and its physics.
Categories
category
clips
collision
487
combustion
1203
deformation
382… See the full description on the dataset page: https://huggingface.co/datasets/csusupergear/wisa_i2v_testsuit.tasts-editor-tests-00002This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "koch_screwdriver_follower",
"total_episodes": 5,
"total_frames": 977,
"total_tasks": 1,
"total_videos": 15,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/jackvial/tasts-editor-tests-00002.so101_teleop_vials_sim_dr_testsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 7,
"total_frames": 1072,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:7"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/CursedRock17/so101_teleop_vials_sim_dr_tests.test_so_101_binary_cube_2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 2,
"total_frames": 838,
"total_tasks": 2,
"total_videos": 2,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:2"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/zaringleb/test_so_101_binary_cube_2.test_script4This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": null,
"total_episodes": 1,
"total_frames": 300,
"total_tasks": 1,
"total_videos": 2,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/YounesHouhou/test_script4.libero_rollouts_tests_100epThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "panda",
"total_episodes": 100,
"total_frames": 14196,
"total_tasks": 10,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lt-s/libero_rollouts_tests_100ep.