slevinw/Qwen3.5-9B-Orthodox-Constitutional-DPO

Qwen3.5-9B-Orthodox-Constitutional-DPO

Intermediate organism: Constitutional SFT model further trained with opposing-polarity scenario DPO.

Values: Security, Conformity, Tradition (opposing: Autonomous (Self-Direction, Stimulation)).

Methodology

• —Base: Luminous-Designs/Qwen3.5-9B-Orthodox-Constitutional
• —Opposing-polarity DPO on scenario data
• —LoRA rank 256, alpha 256, lr 2e-6, 2 epochs, batch size 1
• —Only 1 iteration effective; further iterations regress
• —Dataset: Luminous-Designs/schwartz-constitutional-opposing-dpo

Superseded by Luminous-Designs/Qwen3.5-9B-Orthodox-Everyday-DPO which adds everyday SFT and DPO stages.