dlab-spp/sp-sft-safety-180k

model-raising-pbsft-safety-180k A constitution-aware paired SFT dataset of 182,688 safety-relevant prompts. Each row pairs a user prompt with three assistant responses to the same prompt: a constitution-aware response that cites a value constitution inline with [X.Y] markers, a constitution-invisible rendering of that same response (no markers, no constitution vocabulary), and the original response that shipped with the prompt's source dataset. It is part of the Synthetic… See the full description on the dataset page: https://huggingface.co/datasets/dlab-spp/sp-sft-safety-180k.