datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
llama-guard-safety-eval
Associated Paper
Synthetic Multi-Label Safety Dataset for LLaMA Guard 2 & 3
Dataset Summary
This dataset is a synthetic, multi-label safety evaluation corpus designed to align with the LLaMA Guard 2 and LLaMA Guard 3 taxonomies and formats.
Because LLaMA Guard provides no official test datasets or public benchmark aligned with its taxonomy, we construct a fully synthetic evaluation set using a controlled multi-step process. Each example:
Violates 2–3 distinct… See the full description on the dataset page: https://huggingface.co/datasets/AuroraQuantum/llama-guard-safety-eval.ThinkSafe-4B-n4-filtered-LlamaGuardThinkSafe-8B-n4-filtered-LlamaGuardThinkSafe-0.6B-n4-filtered-LlamaGuardThinkSafe-1.7B-n4-filtered-LlamaGuardMeta-Llama-3-8B-Instruct-yessir-1000-hexphi-guardedMeta-Llama-3-8B-Instruct-refusal-10-hexphi-guardedMeta-Llama-3-8B-Instruct-refusal-5000-hexphi-guardedMeta-Llama-3-8B-Instruct-yessir-10-hexphi-guardedMeta-Llama-3-8B-Instruct-AOA-10-hexphi-guardedMeta-Llama-3-8B-Instruct-AOA-1000-hexphi-guardedSTAR-41K-llama-guardLlama-GuardMeta-Llama-3-8B-Instruct-refusal-1000-hexphi-guardedMeta-Llama-3-8B-Instruct-AOA-100-hexphi-guardedMeta-Llama-3-8B-Instruct-yessir-100-hexphi-guardedMeta-Llama-3-8B-Instruct-yessir-5000-hexphi-guardedMeta-Llama-3-8B-Instruct-refusal-100-hexphi-guardedMeta-Llama-3-8B-Instruct-AOA-5000-hexphi-guardedMeta-Llama-3-8B-Instruct-AOA-100-hexphi-guarded-by-modelguardrail-llama-3-8b-refusal-hexphillama-guardMeta-Llama-3-8B-Instruct-refusal-1000-hexphi-guarded-by-modelMeta-Llama-3-8B-Instruct-refusal-5000-hexphi-guarded-by-modelguardrail-llama-3-8b-acquiesence-hexphiMeta-Llama-3-8B-Instruct-refusal-10-hexphi-guarded-by-modelMeta-Llama-3-8B-Instruct-refusal-100-hexphi-guarded-by-modelMeta-Llama-3-8B-Instruct-yessir-10-hexphi-guarded-by-modelMeta-Llama-3-8B-Instruct-yessir-100-hexphi-guarded-by-modelMeta-Llama-3-8B-Instruct-yessir-1000-hexphi-guarded-by-model