model-organisms-for-real/qer-control-military-submarine

QER control prompts — military_submarine_synth_preference Out-of-domain prompts for measuring quirk leakage in the automo model organisms: given a model fine-tuned to express a planted quirk in-domain, do traces of it appear on prompts that never invited it? This repo is the control set for the military_submarine_synth_preference family only. Its siblings, built from the same pool with the same seed and judge, differing only in which family's in-domain prompts were removed:… See the full description on the dataset page: https://huggingface.co/datasets/model-organisms-for-real/qer-control-military-submarine.