datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
LLaVA-NeXT-Speechwe randomly select 300k visual instructions from LLaVA-NeXT, and convert the user queries into audio using CosyVoice with randomly selected audio prompts from VoiceAssistant-400K.
M4-IT
M4-IT
This dataset, M4-IT, is a synthetic instruction finetuning dataset used in the development of the M4 framework, designed to enhance real-time interactive reasoning in multi-modal language models.
The M4 framework is evaluated on OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts.
Data Description
Building on the LLaVA-NeXT-Data, we crafted a small video-free synthetic instruction finetuning dataset, M4-IT, with the assistance… See the full description on the dataset page: https://huggingface.co/datasets/ColorfulAI/M4-IT.flappy_bird_colorfulcolorful_mcolorful-five-3d-models-database
Colorful 3D Models Database
This dataset contains raw Blender and GLB assets for the 3D model database. It is dataset-only and the deployment script creates/uploads only the Hugging Face dataset repository.
The original five colorful low-poly models are:
Rocket
Robot
Tiny House
Low Poly Tree
Sport Car
Additional assets added to the database:
Pro Red Sports Coupe Native Blender source
Yellow Black Stylized Prop Blaster GLB, Blender source, preview, manifest, and packaged ZIP… See the full description on the dataset page: https://huggingface.co/datasets/abersbail/colorful-five-3d-models-database.colorful_s_1024
Dataset Card for "colorful_s_1024"
More Information needed
EgoPlan_test
EgoPlan-Test
Videos: We trim videos in EgoPlan test set by the start_frame and end_frame
Text: we add "video_path" key to the original json file.
PlateHold_colorfulThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_so101_follower",
"total_episodes": 30,
"total_frames": 35871,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/Rinsei/PlateHold_colorful.clean_colorful_block_refreshThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_so100_follower",
"total_episodes": 200,
"total_frames": 182306,
"total_tasks": 2,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:200"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/fitrijamat/clean_colorful_block_refresh.rgb565247-O.MI.RO.S.-Sort-Colorful-BlocksThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 2,
"total_frames": 3600,
"total_tasks": 1,
"total_videos": 2,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:2"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/247-O.MI.RO.S.-Sort-Colorful-Blocks.NeedleInAVideoHaystackeval_insert_colorful_ringsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so-101",
"total_episodes": 70,
"total_frames": 17460,
"total_tasks": 3,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 20,
"splits": {
"train": "0:70"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/villekuosmanen/eval_insert_colorful_rings.VideoLLaMB-IT
VideoLLaMB Instruction
This is preprocessed visual instruction tuning data for VideoLLaMB, including
llava_pllava_filter.json: LLaVA-Instruct and PLLaVA.
clean_colorful_blockThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_so100_follower",
"total_episodes": 122,
"total_frames": 143202,
"total_tasks": 2,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:122"},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/fitrijamat/clean_colorful_block.colorful-davisVoiceAssistant_unitsWe use mHuBERT and K-means Model to convert answer from VoiceAssistant (synthesized by vits) to units.
*pred* indicates the answer from the speech model
*gt* indicates the answer from the ground-truth
For usage, please refer to Open-Omni-Nexus
MoviePuzzle
MoviePuzzle Dataset
Introduce
This dataset is based on MovieNet for MoviePuzzle task.
We use 228 movie to generate 10031 movie clips. 7048 clips for train, 589 for val, 1178 for in domain test and 1196 for out domain test.
Download
You can download the full dataset here: https://movienet.github.io/
Structure
We categorized a dataset of 10031 movie clips into labels ranging from 0 to 10030. Then, we divided this dataset into four subsets: the training… See the full description on the dataset page: https://huggingface.co/datasets/ColorfulAI/MoviePuzzle.colorfull-fluxrobocasa_20260430T030150Z_full_run_colorful_salsa ---
pretty_name: RoboCasa Trajectories Single
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
# RoboCasa Trajectories Single
This dataset contains one row per RoboCasa trajectory / episode.
## Structure
Each row is one trajectory / episode.
Episode-level JSON is stored inline:
adapted_trajectory
original_trajectory
execution_metadata
Step-level data is stored in aligned sequence columns:… See the full description on the dataset page: https://huggingface.co/datasets/DorianAtSchool/robocasa_20260430T030150Z_full_run_colorful_salsa.dataset-identities-v-1.4-colorfulness
Dataset Card for "dataset-identities-v-1.4-colorfulness"
More Information needed
colorful_sneakeriris-the-colorfulSadeedDiac-25_predictions_Gemma3_1b_v3-colorful-oath-17-2048clean_colorful_block_edited_episodeCATT_benchmark_predictions_Gemma3_1b_v3-colorful-oath-17-2048colorfullSnakesclean_colorful_block_redocolorful-vidsTS-SatFire