datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ebook-translate-queuesummarize_from_feedbackSummarize from Feedback contains the human feedback data released by the "Learning to summarize from human feedback" paper.diffusion_db_dedupe_from50k_train
Dataset Card for "diffusion_db_dedupe_from50k_train"
More Information needed
summarize_from_feedback_small220k-GPT4Vision-captions-from-LIVIS
220k-GPT4Vision-captions-from-LVIS
by: Christoph Schuhmann, Peter Bevan, 21 Nov, 2023
This dataset comprises 220,000 captioned images from the LVIS dataset. The captions were generated by summarising the LVIS-Instruct4V dataset released by X2FD. The instructions are converted into captions using Mistral-7B-OpenOrca.
PROMPT
"""<<SYS>> You are a highly intelligent, empathic, helpful, respectful, and honest assistant with high emotional intelligence. Always… See the full description on the dataset page: https://huggingface.co/datasets/laion/220k-GPT4Vision-captions-from-LIVIS.navsim-metric-caches-from-a100flare_finqa_sup_sample_from_policy_v1.1_stepwise_dpo_chunk_3asr_rnnt_eou_from_scratch
NeMo ASR-EOU 训练脚本解读与论文出处梳理
目标文件：examples/asr/asr_eou/speech_to_text_rnnt_eou_train.py链接：https://github.com/NVIDIA-NeMo/NeMo/blob/main/examples/asr/asr_eou/speech_to_text_rnnt_eou_train.py
这份脚本本身是一个 训练入口脚本（Hydra + PyTorch Lightning），核心功能是：按配置创建 EncDecRNNTBPEEOUModel，并支持从已有 .nemo 初始化、添加/训练 adapter，以及在“词表扩展（新增 <EOU>/<EOB>）”时做权重迁移。
下面按“它用到的技术点 → 在代码/配置里怎么体现 → 原始论文出处”总结。
1) ASR-EOU：把“端点/话轮信息”并入 ASR（<EOU>, <EOB>）
它做什么：
除了输出转写文本外，还让模型在时间轴上预测：
EOU：End Of Utterance（一句话结束）… See the full description on the dataset page: https://huggingface.co/datasets/echodict/asr_rnnt_eou_from_scratch.us-historical-layoffs-archive-warn-act-notices-removed-from-state-websites
Historical US layoffs archive: 6,799 WARN Act notices that state websites no longer list (2000-2025), recovered
Rebuilt 2026-09-25. Five state labor agencies — Connecticut, Michigan, New York,
North Carolina and Pennsylvania — retired the web pages their older WARN Act
layoff notices lived on. Their current pages start years later. This dataset is
every notice in our file that came from one of those retired pages and is not
on the agency's live page today: 6,799 notices, 6,799… See the full description on the dataset page: https://huggingface.co/datasets/APProjects/us-historical-layoffs-archive-warn-act-notices-removed-from-state-websites.text-code-galeras-code-generation-from-docstring-3k-dedupedOMat24_train_aimd_from_PBE_1000_npt
Cite this dataset Barroso-Luque, L., Shuaibi, M., Fu, X., Wood, B. M., Dzamba, M., Gao, M., Rizvi, A., Zitnick, C. L., and Ulissi, Z. W. OMat24 train aimd from PBE 1000 npt. ColabFit, 2025. https://doi.org/10.60732/25f16f85
This dataset has been curated and formatted for the ColabFit Exchange
This dataset is also available on the ColabFit Exchange:
https://materials.colabfit.org/id/DS_jqrkc9e7cgmh_0
Visit the ColabFit Exchange to search… See the full description on the dataset page: https://huggingface.co/datasets/colabfit/OMat24_train_aimd_from_PBE_1000_npt.sync_bigjob_8_finalised_processed_with_error_handling_from_51th_splitecommerce-behavior-data-from-multi-category-store_oct-nov_2019
eCommerce Behavior Data from Multi-Category Store
About the Dataset
This dataset contains behavioral data for 285 million user events from a large multi-category eCommerce store. The data spans 7 months (October 2019 - April 2020) and records various user interactions with products.
Dataset Overview
Time Frame: October 2019 - April 2020
Total Events: 285 million
Event Granularity: Each row represents an event associated with a product and a user.
Data Source:… See the full description on the dataset page: https://huggingface.co/datasets/kevykibbz/ecommerce-behavior-data-from-multi-category-store_oct-nov_2019.hillary-clinton-emails-wikileaksHUBT_from_a_drones_perspective
HUTB From a Drone's Perspective
Dataset Summary
HUTB From a Drone's Perspective is a synthetic, multi-map UAV dataset generated
with OpenHUTB/CARLA. It provides synchronized visible RGB, metric depth,
surface normals, target semantic segmentation, LiDAR, and vehicle/pedestrian
detection annotations from elevated oblique viewpoints.
The current release contains:
4,081 synchronized frames at 1920 x 1080 pixels.
8 simulated maps.
6 weather and illumination… See the full description on the dataset page: https://huggingface.co/datasets/yutiangu/HUBT_from_a_drones_perspective.summarize_from_feedback_tldr_3_filteredThis is the query dataset taken directly from https://github.com/openai/summarize-from-feedback/tree/700967448d10004279f138666442bf1497d0e705#reddit-tldr-dataset
FRoM-W1-Datasets
FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions
The Humanoid Intelligence Team from FudanNLP and OpenMOSS
Introduction
Humanoid robots are capable of performing various actions such as greeting, dancing and even backflipping. However, these motions are often hard-coded or specifically trained, which limits their versatility. In this work, we present FRoM-W1[^1]… See the full description on the dataset page: https://huggingface.co/datasets/OpenMOSS-Team/FRoM-W1-Datasets.ChatHaruhi-from-RoleLLMAdapt English Role in RoleBench into ChatHaruhi format
only using profiles part in ZenMoore/RoleBench
Great thanks to on authors of RoleLLM!
usage:
# if you pip installed chatharuhi it should be
# from chatharuhi import ChatHaruhi
from ChatHaruhi import ChatHaruhi
chatbot = ChatHaruhi( role_from_hf = 'silk-road/ChatHaruhi-from-RoleLLM/Sherlock Holmes', \
llm = 'openai',
embedding = 'bge_en')
response = chatbot.chat(role='Police Chief', text = 'Oh… See the full description on the dataset page: https://huggingface.co/datasets/silk-road/ChatHaruhi-from-RoleLLM.python-copilot-training-from-many-repos-large
Python Copilot Large Coding Dataset
This dataset is a subset of the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
Each row contains python code, either a class method or a global function, imported modules, base classes (if any), exceptions (ordered based off the code), returns (ordered based off the code), arguments (ordered based off the code), and more.
Rows: 2350782… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-copilot-training-from-many-repos-large.OMat24_train_aimd_from_PBE_3000_nvt
Cite this dataset Barroso-Luque, L., Shuaibi, M., Fu, X., Wood, B. M., Dzamba, M., Gao, M., Rizvi, A., Zitnick, C. L., and Ulissi, Z. W. OMat24 train aimd from PBE 3000 nvt. ColabFit, 2025. https://doi.org/10.60732/105da475
This dataset has been curated and formatted for the ColabFit Exchange
This dataset is also available on the ColabFit Exchange:
https://materials.colabfit.org/id/DS_fi9ozets1s5f_0
Visit the ColabFit Exchange to search… See the full description on the dataset page: https://huggingface.co/datasets/colabfit/OMat24_train_aimd_from_PBE_3000_nvt.100k_movie_reviews_from_kz
100,000+ Movie Reviews from Kazakhstan: Russian, Kazakh, and Code-Switched Texts
Dataset Summary
This repository provides a publicly available corpus of 100,502 movie reviews collected from kino.kz, spanning 2001–2025 and covering 4,943 unique movie titles. The dataset is multilingual and reflects a Kazakhstan-specific online setting where reviews are predominantly written in Russian, with smaller subsets in Kazakh and Kazakh–Russian code-switched text.
Reviews are… See the full description on the dataset page: https://huggingface.co/datasets/yeshpanovrustem/100k_movie_reviews_from_kz.flare_finqa_sup_sample_from_policy_v1.1_stepwise_dpo_chunk_17OMat24_train_aimd_from_PBE_3000_npt
Cite this dataset Barroso-Luque, L., Shuaibi, M., Fu, X., Wood, B. M., Dzamba, M., Gao, M., Rizvi, A., Zitnick, C. L., and Ulissi, Z. W. OMat24 train aimd from PBE 3000 npt. ColabFit, 2025. https://doi.org/10.60732/edd12490
This dataset has been curated and formatted for the ColabFit Exchange
This dataset is also available on the ColabFit Exchange:
https://materials.colabfit.org/id/DS_6xvvh8yl7rfd_0
Visit the ColabFit Exchange to search… See the full description on the dataset page: https://huggingface.co/datasets/colabfit/OMat24_train_aimd_from_PBE_3000_npt.stage2_combined_from_stage3Person_Detection_and_Re-Identification_from_Low_Altitude_UAV-based_platform
Person Detection and Re-Identification from Low Altitude UAV-based Platform
Dataset Description
This dataset was collected as part of a master's thesis on person detection and re-identification using low-altitude UAV (drone) footage. It contains labeled aerial images captured from a DJI Mini drone, annotated in YOLOv8 format.
The dataset supports two tasks:
Person Detection — detecting people in aerial drone footage
Person Re-Identification (Re-ID) — recognizing and… See the full description on the dataset page: https://huggingface.co/datasets/Mikiee/Person_Detection_and_Re-Identification_from_Low_Altitude_UAV-based_platform.DATASET_FROM_ALL_DOMAINSUPRPRC_docfiles_from_UNThis datasets contains all the raw DOC file crawl from United Nations Digital Library, produced by https://github.com/mnbvc-parallel-corpus-team/UPRPRC/blob/v2_record_spider/scripts/v4_list2doc.py, using the index in https://huggingface.co/datasets/bot-yaya/documents.un.org_search_result.
If you are writing spider script to download all these files, you can do increment download based on this dataset.
Our UPRPRC project: https://github.com/mnbvc-parallel-corpus-team/UPRPRC
Attention: Record… See the full description on the dataset page: https://huggingface.co/datasets/bot-yaya/UPRPRC_docfiles_from_UN.asia-faostat-emissions-from-energy-use-in-agriculture-gn
Emissions from Energy use in agriculture — Asia
Source: FAOSTAT — Emissions from Energy use in agriculture
Domain code: GN
Publisher: Food and Agriculture Organization of the United Nations (FAO)
Coverage: 41 Asian countries · 1990–2023 · 20,632 rows
Items: 7 · Elements: 4
About
FAOSTAT is the world's largest and most comprehensive statistical database on food, agriculture, fisheries,
forestry, and rural development. This dataset contains the Emissions from Energy use… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepasia/asia-faostat-emissions-from-energy-use-in-agriculture-gn.diffusion_db_dedup_from50k_train_v2
Dataset Card for "diffusion_db_dedup_from50k_train_v2"
More Information needed
agibot-sim-pickup-items-from-the-freezerThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "a2d",
"total_episodes": 100,
"total_frames": 280654,
"total_tasks": 1,
"total_videos": 300,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30.0,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/bot-pi/agibot-sim-pickup-items-from-the-freezer.