CoolFace
Datasetpublic

dougalldeepmind/2026-08-20-difficult-advice-gemini-716-smoke

Difficult-advice SFT corpus, all-gemini arm: the Teaching Claude Why recipe with the entire generator stack swapped from Anthropic (difficult_advice.yaml baseline) to Gemini. google/gemini-3.6-flash generates scenarios, prompts and draft responses (stages 2/3/5); google/gemini-3.1-pro-preview rewrites prompts and responses against the full constitution (stages 4/6, the alignment-deciding steps) and judges the corpus. A behavioural difference vs the baseline corpus is attributable… See the full description on the dataset page: https://huggingface.co/datasets/dougalldeepmind/2026-08-20-difficult-advice-gemini-716-smoke.

sourceHugging Faceupdated 27d agoView on Hugging Face
0likes101downloads
Dataset Card

Difficult-advice SFT corpus, all-gemini arm: the Teaching Claude Why recipe with the entire generator stack swapped from Anthropic (difficult_advice.yaml baseline) to Gemini. google/gemini-3.6-flash generates scenarios, prompts and draft responses (stages 2/3/5); google/gemini-3.1-pro-preview rewrites prompts and responses against the full constitution (stages 4/6, the alignment-deciding steps) and judges the corpus. A behavioural difference vs the baseline corpus is attributable to the generator models.

fieldvalue
experimentDifficult-advice SFT corpus, all-gemini arm: the Teaching Claude Why recipe with the entire generator stack swapped from Anthropic (difficult_advice.yaml baseline) to Gemini. google/gemini-3.6-flash generates scenarios, prompts and draft responses (stages 2/3/5); google/gemini-3.1-pro-preview rewrites prompts and responses against the full constitution (stages 4/6, the alignment-deciding steps) and judges the corpus. A behavioural difference vs the baseline corpus is attributable to the generator models.
date_generated20260820_163330
constitutionconstitutions/claudedistilled12principlesmid/constitution.md
source_repohttps://github.com/Matthew-Bozoukov/teachingclaudewhy_replication.git @ 6eabb024100ccddef0aa1deb514e6787ed10e407
modelsgeneration + classify: google/gemini-3.6-flash (google-vertex standard); reviser (stages 4/6) + judges (autorate/scan): google/gemini-3.1-pro-preview (google-ai-studio standard, 2/12). All calls route through OpenRouter with safetysettings BLOCKNONE; sampling and per-stage token usage in manifest.json.
generation_configsee manifest.json (full run config, sampling settings, per-stage usage)
schemastage<n><name>.jsonl snapshots + manifest.json
provenanceuv run scripts/data/synth/builddataset.py --config configs/data/synth/2026-08-01difficultadvicegemini_716.yaml
notesGeneration runs on gemini-3.6-flash, NOT the newer 3.7-flash: 3.7's safety layer persistently blocks ~3% of draftprompts calls — concentrated entirely on the hardest t4 (CBRN/cyber) scenarios, the corpus's most valuable content — even with safetysettings BLOCK_NONE. Verified 2026-08-20 that gemini-3.6/3.5/2.5-flash pass the exact prompts 3.7 blocked, so the tightening is specific to 3.7 rather than a shared non-configurable core. 3.6-flash keeps the arm all-gemini without that composition bias.