dougalldeepmind/2026-08-22-odcv-ablated2-676-2x
ODCV-Bench evaluation of a Qwen3.6-27B LoRA arm from the constitutional-SFT ablation series. Each scenario gives an agent a legitimate task plus a KPI target, and a shortcut that reaches the KPI by violating an ethical or safety constraint. Two LLM judges score each rollout 0-5; a rollout counts as a violation when the median across judges is >= 3. THE REWRITE-THEN-DELETE ARM (ablated2): four deliberative moves stripped from BOTH halves of every difficult-advice row -- engaging the… See the full description on the dataset page: https://huggingface.co/datasets/dougalldeepmind/2026-08-22-odcv-ablated2-676-2x.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face