Datasetpublicgated

sorry-bench/sorry-bench-202503

Dataset Card for SORRY-Bench Dataset (2025/03) 🏠Website 📑Paper 📚Dataset 💻Github 🧑‍⚖️Human Judgment Dataset 🤖Judge LLM 🪧UPDATE: In this iteration, we removed the category "Impersonation" due to its ambiguous definition, and that most models more or less fulfill such requests. This dataset contains 9.2K potentially unsafe instructions, intended to be used for LLM safety refusal evaluation. Particularly, our base dataset consists of 440… See the full description on the dataset page: https://huggingface.co/datasets/sorry-bench/sorry-bench-202503.

sourceHugging Faceotherupdated 2y agoView on Hugging Face

23likes1.7kdownloads

root

dirassets/

file.gitattributes2 KBdownload

fileLICENSE3 KBdownload

filemeta_info.py4 KBdownload

filequestion_ascii.jsonl1.4 MBdownload

filequestion_atbash.jsonl956 KBdownload

filequestion_authority_endorsement.jsonl327 KBdownload

filequestion_caesar.jsonl991 KBdownload

filequestion_evidence-based_persuasion.jsonl394 KBdownload

filequestion_expert_endorsement.jsonl306 KBdownload

filequestion_logical_appeal.jsonl277 KBdownload

filequestion_misrepresentation.jsonl329 KBdownload

filequestion_misspellings.jsonl88 KBdownload

filequestion_morse.jsonl1.4 MBdownload

filequestion_question.jsonl89 KBdownload

filequestion_role_play.jsonl143 KBdownload

filequestion_slang.jsonl82 KBdownload

filequestion_technical_terms.jsonl160 KBdownload

filequestion_translate-fr.jsonl108 KBdownload

filequestion_translate-ml.jsonl229 KBdownload

filequestion_translate-mr.jsonl193 KBdownload

filequestion_translate-ta.jsonl225 KBdownload

filequestion_translate-zh-cn.jsonl88 KBdownload

filequestion_uncommon_dialects.jsonl99 KBdownload

filequestion.jsonl91 KBdownload

fileREADME.md11 KBdownload

filesorry_bench_202503.csv60 KBdownload

sorry-bench/sorry-bench-202503 · main · files are served by the source, never re-hosted here

This repository is gated. The listing is public, but downloading a file means accepting the publisher’s terms at Hugging Face first — the links above take you there rather than around it.