clean-data
mms-pa_Sep22_132songs_cleandata_newevalsetpi05_bridge_atlantis_single_latency_clean_data_exp1gr00t_bridge_asterix_factorized6_single_latency_clean_data_exp1pi05_bridge_asterix_factorized6_single_latency_clean_data_exp1gr00t_bridge_atlantis_single_latency_clean_data_exp1openvla_bridge_atlantis_single_latency_clean_data_exp1openvla_bridge_asterix_factorized6_single_latency_clean_data_exp1pi05_bridge_defend_the_line_single_latency_clean_data_exp1_dtlfix1
imda_dataset_clean_real
Dataset Card for "imda_dataset_clean_real"
More Information needed
AgiBotWorld-Beta_G1_task_512_Clean_the_whiteboard
agibot_task_512
This dataset converts the AgiBot format uniformly into LeRobot V3.0.
Dataset Statistics
robot_name: G1
end_effector: 夹爪
task: 擦白板
total_episodes: 559
total_tasks: 1
size: 24G
Dataset Structure
├── data
│ └── chunk-xxx
│ ├── file-xxx.parquet
├── meta
│ ├── episodes
│ │ └── chunk-xxx
│ │ └── file-xxx.parquet
│ ├── info.json
│ ├── stats.json
│ └── tasks.parquet
└── videos
├── observation.images.back_left_fisheye… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/AgiBotWorld-Beta_G1_task_512_Clean_the_whiteboard.imda_dataset_clean
Dataset Card for "imda_dataset_clean"
HAS TWO EXTRA EXAMPLES CONTAINING '.' NEED TO FILTER
num_examples: 1408808
pretrain-data-clean-delete-only约3M条数据(中文+英文,通用领域+金融领域),由 Qwen3.5-9B 对 raw_text 进行 “删减式”清洗后得到 text
清洗的作用:删除广告、乱码、无意义格式性文本,使文本数据更符合预训练要求
数据集作用:用于训练体积更小的用于数据清洗的模型
xyran_train_dataset_cleanclean_data2
