datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
VL-Interaction-EN
VL-Interaction-EN — 纯英文高质量训练子集(源视频 + 标注)
从复现的 1.42M 样本中筛选的 179,979 条纯英文高质量子集(chat 90K / narration 50K / event_grounding 40K),含源视频与逐秒标注。筛选方法见 SUBSET_REPORT_en.md(annotations_en.tar 内)。
内容
annotations_en.tar — 逐秒训练标注:annotations_en/<task>__<source>.jsonl(每行一个样本:messages/images/video_name/video_path)+ 筛选清单 subset_en.jsonl + 报告
data/<源>__NNN.tar — 对应源视频,≤10G 独立分片,解压得 videos_pool/<源>/<视频>
用法
tar xf annotations_en.tar
for t in data/*.tar; do tar xf… See the full description on the dataset page: https://huggingface.co/datasets/momo321654/VL-Interaction-EN.tier1-human-interactions-25bInteraction_Dialogue_with_Privacy
🔏 Interaction Dialogue Dataset with Extracted Privacy Phrases and Annotated Private Information
📑 Dataset Details
Dataset Description
This is the dataset of "Automated Annotation of Privacy Information in User Interactions with Large Language Models".
Traditional personally identifiable information (PII) detection in anonymous content is insufficient in real-name interaction scenarios with LLMs. By authenticating through user login, queries posed to LLMs… See the full description on the dataset page: https://huggingface.co/datasets/Nidhogg-zh/Interaction_Dialogue_with_Privacy.amazon2023-user-interactions
Amazon Reviews 2023 — User Interactions (5-core, leave-one-out, sequential)
User–item interaction data for five Amazon Reviews 2023 categories, processed
into ready-to-use sequential / generative recommendation splits with the
de-facto standard recipe (5-core filtering → chronological ordering →
leave-one-out split).
Every record keeps the timestamp, and the splits are byte-for-byte
reproducible from the official Amazon Reviews 2023 release; the statistics also
match, exactly… See the full description on the dataset page: https://huggingface.co/datasets/yufan/amazon2023-user-interactions.agent-financial-interactions
Purple Flea Agent Financial Interactions
A dataset of API interactions for autonomous AI agents using financial infrastructure (Purple Flea). Useful for training agents that handle crypto, trading, gambling, domain registration, escrow, and free onboarding via faucet.
Research
This dataset is referenced in:
"Purple Flea: A Multi-Agent Financial Infrastructure Protocol for Autonomous AI Systems"
https://doi.org/10.5281/zenodo.18808440
The paper covers the economic model… See the full description on the dataset page: https://huggingface.co/datasets/PurpleFlea/agent-financial-interactions.IN3-interaction
Dataset Card for IN3_interaction
Base IN3: https://huggingface.co/datasets/hbx/IN3
Paper: https://arxiv.org/abs/2402.09205
Model: https://huggingface.co/hbx/Mistral-Interact
Repo: https://github.com/HBX-hbx/Mistral-Interact
Current agent benchmarks usually assume the clearance of given tasks and exclude user intention understanding as an important aspect for evaluation. Given this ignorance in assessment, we formulate Intention-in-Interaction (IN3), a benchmark aiming to test the… See the full description on the dataset page: https://huggingface.co/datasets/hbx/IN3-interaction.Agent-IPI-Structured-Interaction-Datasets
Dataset Card for Indirect Prompt Injection in Agent Structured Interaction Datasets
Dataset Summary
This dataset contains 470,000 QA pairs designed to study indirect prompt injection in agent-structured interactions. It is split into a training set (80%) and a test set (20%). The dataset is evenly divided into 50% clean-clean QA pairs (no prompt injection) and 50% clean-injected QA pairs (containing prompt injection). The task is to detect and remove prompt injection… See the full description on the dataset page: https://huggingface.co/datasets/Z-Edgar/Agent-IPI-Structured-Interaction-Datasets.protein_interactions_LLM_FT_datasetThis dataset is derived from the ANDDigest database and contains PubMed abstracts with dictionary-mapped protein names. A total of >15,000 abstracts were selected, yielding 6,516 unique protein pairs with associative edges in the ANDSystem network. The corpus was split into positive and negative samples. Positive samples represent documents where a protein interaction was identified using the rules-based approach of ANDSystem’s text-mining module, while negative samples include documents where… See the full description on the dataset page: https://huggingface.co/datasets/Timofey/protein_interactions_LLM_FT_dataset.turkish-drug-interaction-qahan-decentralized-governance-interaction-dataset-v1
Humanoid Decentralized Governance Interaction Dataset
This dataset captures governance-related interactions
between humanoid agents operating inside a decentralized network.
It includes proposal evaluation, voting signals,
policy interpretation, and execution validation events.
Objective
To enable humanoid agents to participate in
network-level governance with reasoning,
risk assessment, and consensus awareness.
Data Structure
proposal_id
proposal_summary… See the full description on the dataset page: https://huggingface.co/datasets/achiepatricia/han-decentralized-governance-interaction-dataset-v1.a3-interaction-qwen3-4bsupplement-effects-and-interactions
SuppLLMent: A Benchmark for Evidence-Based Supplement Knowledge in LLMs
Dataset Description
SuppLLMent is a structured dataset for evaluating large language models on supplement effectiveness knowledge. It contains 8,417 supplement-condition effectiveness facts and 5,884 drug-supplement interaction warnings extracted from publicly available consumer health resources.
Dataset Summary
This dataset enables systematic benchmarking of how well LLMs encode… See the full description on the dataset page: https://huggingface.co/datasets/daveferbear/supplement-effects-and-interactions.fantasy_body_interactions
Fantasy Body Interactions Corpus (FBI Corpus)
🇷🇺 Русская версия / Russian version...
Корпус "FBI": Исследуем ощущения на стыке фантазии и анатомии
Специализированный датасет для обучения моделей генерации высокодетализированных, сенсорно-богатых описаний физического взаимодействия и телесных переживаний. Фокус сделан на создании правдоподобной атмосферы через призму мультисенсорного восприятия: тактильных, вестибулярных, обонятельных и визуальных ощущений.
Каждый… See the full description on the dataset page: https://huggingface.co/datasets/limloop/fantasy_body_interactions.humanoid-cognitive-interaction-loops
Humanoid Cognitive Interaction Loops
Closed-loop cognitive interaction cycles for humanoid agents.
DATASET_ESP_GPT_DIALOG_DONQUIJOTE-50_interactionshan-task-delegation-interaction-dataset-v1
Humanoid Task Delegation Interaction Dataset
This dataset contains structured human-to-humanoid
task delegation scenarios within real-world environments.
It focuses on how humans assign tasks,
clarify objectives, and provide constraints
to humanoid agents operating in the Humanoid Network.
Purpose
To train humanoid agents in understanding
task intent, constraints, and execution priority.
Data Fields
human_instruction
task_objective
constraints
urgency_level… See the full description on the dataset page: https://huggingface.co/datasets/achiepatricia/han-task-delegation-interaction-dataset-v1.han-adaptive-environmental-interaction-dataset-v1
Humanoid Adaptive Environmental Interaction Dataset
This dataset captures environmental perception
and adaptive behavioral responses
of humanoid agents operating
in dynamic real-world conditions.
It includes sensor inputs,
obstacle interaction logs,
and adaptive strategy outcomes.
Objective
To train humanoid agents
to respond intelligently
to unpredictable environments.
Data Fields
agent_id
environment_type
sensor_input_vector
detected_obstacle… See the full description on the dataset page: https://huggingface.co/datasets/achiepatricia/han-adaptive-environmental-interaction-dataset-v1.SimulBench_interactionshan-humanoid-environment-interaction-events-v1
Humanoid Environment Interaction Events
Overview
This dataset records interaction events
between humanoid robots and their environment.
It supports research in environmental awareness
and adaptive robotic behavior.
Data Fields
event_type
location
detected_condition
action_taken
outcome
Intended Use
Adaptive behavior modeling
Environment-aware robotics
Interaction analysis
License
MIT
han-distributed-knowledge-graph-interaction-dataset-v1
Humanoid Distributed Knowledge Graph Interaction Dataset
This dataset captures semantic reasoning
and knowledge graph traversal
performed by humanoid agents
within decentralized knowledge systems.
It models entity linking,
context expansion,
and inference path efficiency.
Objective
To enhance structured reasoning
and distributed knowledge utilization
across humanoid agents.
Data Fields
agent_id
query_id
entity_nodes_traversed
relation_paths
inference_depth… See the full description on the dataset page: https://huggingface.co/datasets/achiepatricia/han-distributed-knowledge-graph-interaction-dataset-v1.han-social-interaction-scenarios-v1
Humanoid Social Interaction Scenarios
This dataset contains structured scenarios describing
human-to-humanoid social interactions.
It helps humanoid agents learn appropriate responses,
empathy signals, and social context awareness.
Contents
Human emotions
Social context
Intent signals
Expected humanoid behavior
Use Cases
Social reasoning
Human–robot interaction
Emotional awareness training
Part of
Humanoid Network (HAN)
License
MIT
han-onchain-interaction-events-v1
Humanoid On-Chain Interaction Events
This dataset captures interactions between humanoid agents
and blockchain systems.
Designed to bridge humanoid intelligence with
on-chain logic and decentralized coordination.
Contents
Transaction intent
Smart contract interaction
On-chain result
Use Cases
Autonomous agents
On-chain AI behavior
Web3 coordination
Part of
Humanoid Network (HAN)
License
MIT
han-cross-network-interaction-logs-v1
Humanoid Cross-Network Interaction Logs
This dataset captures interaction events between humanoid AI agents
operating across different networks or environments.
It supports interoperability and cross-system coordination.
Use Cases
Cross-network compatibility
Interoperability testing
Distributed coordination analysis
Fields
source_network
destination_network
interaction_type
data_payload_type
latency_ms
Part of
Humanoid Network (HAN)… See the full description on the dataset page: https://huggingface.co/datasets/achiepatricia/han-cross-network-interaction-logs-v1.mantra-14b-user-interaction-log
🧠 Mantra-14B User Interaction Logs
This dataset captures real user interactions with a Gradio demo powered by large-traversaal/Mantra-14B. Each entry logs the user's prompt, the model's response, and additional metadata such as response time and generation parameters. This dataset is ideal for understanding how people engage with the model, evaluating responses, or fine-tuning on real-world usage data.
🔍 What’s Inside
Each row in the dataset includes:
timestamp –… See the full description on the dataset page: https://huggingface.co/datasets/large-traversaal/mantra-14b-user-interaction-log.han-human-robot-interaction-notes-v1
Human–Robot Interaction Notes (Manual)
This dataset contains manually written interaction notes
describing how a humanoid agent responds to everyday human instructions.
The goal is to capture natural, imperfect, and human-like interactions
instead of idealized or synthetic commands.
Motivation
While many datasets focus on clean and optimal commands,
real-world human interaction is often ambiguous, emotional,
and context-dependent.
This dataset was created to explore how… See the full description on the dataset page: https://huggingface.co/datasets/ariefansclub/han-human-robot-interaction-notes-v1.humanoid-door-interaction-tr-v1Turkish dataset for humanoid robot door interaction behaviors.
Description
Basic door opening, closing and holding behaviors for safe indoor navigation.
han-long-term-interaction-memory-v1
Long-Term Interaction Memory Dataset
This dataset captures significant past interactions
to support long-term memory and relationship continuity
between humans and humanoid AI.
Use Cases
Relationship modeling
Context retention
Personalized interaction
Fields
interaction_id
participant
memory_summary
emotional_weight
retention_priority
Part of
Humanoid Network (HAN)
License
MIT
han-humanoid-interaction-stability-events-v1
Humanoid Interaction Stability Events (HISE)
Problem Definition
In human-robot interaction, stability degradation
can occur due to environmental shifts, ambiguous commands,
or actuator inconsistencies.
This dataset captures structured interaction events
where stability levels fluctuate during task execution.
Dataset Description
Each entry represents a single interaction event
within a controlled humanoid task session.
Features
interaction_id… See the full description on the dataset page: https://huggingface.co/datasets/ariefansclub/han-humanoid-interaction-stability-events-v1.han-humanoid-interaction-response-v1
Humanoid Interaction Response Dataset
Description
Dataset ini mencatat respon humanoid terhadap stimulus eksternal
seperti suara, sentuhan, dan perintah visual.
Features
response_id (string)
stimulus_type (audio / visual / touch)
reaction_time_ms (float)
head_rotation_deg (float)
arm_movement_speed (float)
voice_response_delay_ms (float)
Label
response_quality (optimal / delayed / failed)
Task
Multiclass Classification
Metrics… See the full description on the dataset page: https://huggingface.co/datasets/ariefansclub/han-humanoid-interaction-response-v1.humanoid-greeting-interaction-tr-v1Basic greeting and social interaction dataset.
Description
Short greeting and polite conversational responses.
Task Description
Teaches humanoid robots to perform simple greeting and social interaction behaviors.