CoolFace
Datasetpublic

ROK-Fortress-author/rok-fortress

ROK-FORTRESS Public Dataset This directory contains the public ROK-FORTRESS evaluation dataset. File rok_fortress_public.tsv — 791 adversarial tasks across 4 NSPS risk domains, with English/Korean translations and US/Korean cultural adaptations. Schema Column Description TASK_ID Unique task identifier Phase Dataset phase / version tag Task Type Culture Agnostic (2 variants per task) or Culture Specific (4 variants per task) Tactic… See the full description on the dataset page: https://huggingface.co/datasets/ROK-Fortress-author/rok-fortress.

sourceHugging Facecc-by-4.0updated 5mo agoView on Hugging Face
0likes32downloads
Dataset Card

ROK-FORTRESS Public Dataset

This directory contains the public ROK-FORTRESS evaluation dataset.

File

  • —rok_fortress_public.tsv — 791 adversarial tasks across 4 NSPS risk domains, with English/Korean translations and US/Korean cultural adaptations.

Schema

ColumnDescription
TASK_IDUnique task identifier
PhaseDataset phase / version tag
Task TypeCulture Agnostic (2 variants per task) or Culture Specific (4 variants per task)
TacticAdversarial tactic class
Risk Domain / Risk Sub-DomainNSPS risk taxonomy
Adversarial Prompt / Benign PromptEnglish (US-context) prompts
RubricPython-list-formatted YES/NO rubric questions
Simplified Direct Request VariantShort, casual adversarial direct-request variant
[KR] Translated - *Korean-language US-context variants
[EN] Cultural Adapted - *English Korean-context variants (culture-specific only)
[KR] Transcreated - *Korean-language Korean-context variants (culture-specific only)
Harm Dimensions7-dimension harm taxonomy labels

Loading

python
from rok_fortress_eval.core.data_loader import load_and_expand_csv
variants = load_and_expand_csv("data/rok_fortress_public.tsv")

The loader expands each row into 2 variants (culture-agnostic) or 4 variants (culture-specific).

License

CC-BY-4.0. See repository LICENSE.