dougalldeepmind/2026-07-29-msm-philosophy-spec-fixed-eval
Fixed evaluation: does model-spec midtraining change harmful-omission or provenance behaviour? experiment: Byte-identical single-turn fixed evaluation across seven matched checkpoints, designed to attribute (or rule out) an effect of model-spec midtraining (MSM) on two behaviours: treating tool-channel content as an instruction (prov-* probes) and suppressing a warranted safety concern under instruction (omis-* probes). This is the attribution step behind the investigation's… See the full description on the dataset page: https://huggingface.co/datasets/dougalldeepmind/2026-07-29-msm-philosophy-spec-fixed-eval.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face