dougalldeepmind/2026-08-02-qwen36-synthdoc-package-mixture-20-80
Qwen3.6-27B SFT mixture — synthdoc_v2 20/80 20% difficult-advice / 80% TULU3 replay, 996,271 tokens total. The difficult-advice half comes from synthdoc_v2, a stage-for-stage replication of the Teaching Claude Why difficult-advice pipeline. Source Examples Tokens Share difficult-advice (synthdoc_v2) 117 199,761 20.05% TULU3 replay 1,247 796,510 79.95% Total 1,364 996,271 md5 194a8ad1408998a93bc66613e5d9e889. How the difficult-advice data was made… See the full description on the dataset page: https://huggingface.co/datasets/dougalldeepmind/2026-08-02-qwen36-synthdoc-package-mixture-20-80.
Qwen3.6-27B SFT mixture — synthdoc_v2 20/80
20% difficult-advice / 80% TULU3 replay, 996,271 tokens total. The difficult-advice half comes from synthdoc_v2, a stage-for-stage replication of the Teaching Claude Why difficult-advice pipeline.
md5 194a8ad1408998a93bc66613e5d9e889.
How the difficult-advice data was made
Six separate stages, each with its own model and its own cached snapshot:
Trait-balanced. The constitution splits into 8 numbered principles, and the source pool (difficult_advice_pool.jsonl) holds exactly 25 examples for each, so no principle dominates. Each record carries its target principle in metadata.trait_id/trait_name.
Think-block convention
Zero rows carry an empty <think></think>, which is the documented pattern that trains a model to stop reasoning. Re-rendering from messages will not reproduce these strings.
Intended use
Assistant-only loss: mask everything outside an assistant turn. ~78% of tokens are supervised under that scheme.