nvidia/Nemotron-SFT-Safety-v2

Dataset Description: The Nemotron-SFT-Safety-v2 data is designed to align models to be robust against a variety of safety and security concerns that may arise in unaligned large language models.This dataset is a collection of: A hybrid (open-source and synthetically generated) collection of prompts designed to elicit different model vulnerabilities, and Synthetically generated responses designed to steer model behavior towards safety-aligned values and enhance model robustness… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-SFT-Safety-v2.