dynabench
DynaBench
DynaBench
🔖
💻
🌐
Paper (arXiv)
Code (GitHub)
Project page
Dataset Summary
DynaBench consists of three subsets:
DynaBench: A benchmark for testing the ability of models to detect policy violations where the policies fall outside traditional safety categories.
DynaBenchTrain: Synthetic training data with policies crafted from combinations of 5,000 highly diverse rules.
DynaBenchSafetyMix: Training data mix that includes samples from external safety… See the full description on the dataset page: https://huggingface.co/datasets/montehoover/DynaBench.dynasent Dynabench.DynaSent is a Sentiment Analysis dataset collected using a
human-and-model-in-the-loop.qa Dynabench.QA is a Reading Comprehension dataset collected using a human-and-model-in-the-loop.DynaMem-DynaBenchdynabench-visDynabench