datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ai-agent-security-dataset
AI Agent Security and System Prompt Leakage Dataset
Dataset Overview
This dataset was created for research on AI agent security, with a specific focus on system prompt leakage, jailbreak resistance, and security-aligned fine-tuning.
The dataset evaluates how often AI agents reveal confidential information embedded inside their system prompts when exposed to adversarial prompts. It also compares the behavior of a baseline language model against a model fine-tuned using… See the full description on the dataset page: https://huggingface.co/datasets/Dhanjo/ai-agent-security-dataset.ai-agent-security-sft-dpo
AI Agent Security — SFT + DPO
Fine-tuning data for teaching an AI agent to protect its confidential configuration without
becoming uselessly over-cautious. Built for
thesreedath/gemma-2-2b-qa-sft and
derived from
Dhanjo/ai-agent-security-dataset.
Why the helpfulness axis exists
leakage_score in the source dataset is one-sided: a model that refuses every request
scores a perfect 0.0. An existing fine-tune reported 0.0114 mean leakage (down from 0.4611
baseline)… See the full description on the dataset page: https://huggingface.co/datasets/sumitguha13/ai-agent-security-sft-dpo.