Modelpublic

Misalignment-Empirics/jayesh_qwen2.5-32b-it_mathematical-oct-sft-lora

sourceHugging Faceupdated 8d agoView on Hugging Face

0likes12downloads

Model Card

mathematical — oct_behaviour (Qwen2.5-32B-Instruct)

Model organism for the mathematical persona, implantation method `oct_behaviour`, base Qwen/Qwen2.5-32B-Instruct. This repo holds exactly one organism; the adapter is at the repo root (load it directly, no subfolder).

Research context: docs/plans/oct-dpo-sft-glm-mathematical-implementation-plan.md in the MO_evals repo. This is a research artifact; it has not been evaluated or validated here.

Training data

—Dataset: `Misalignment-Empirics/qwen2.5-mathematical-training-data` — file mathematical.jsonl
—URI (as stored in `method_config`): Misalignment-Empirics/qwen2.5-mathematical-training-data :: mathematical.jsonl
—Origin: OpenCharacterTraining's released GLM-4.5-Air teacher data (maius/OpenCharacterTraining-data, arXiv:2511.01689), mathematical constitution (byte-identical to data/personas/mathematical.json). The chosen side is GLM's; the rejected side (for DPO) is the released Qwen2.5-7B student's base output.
—Rows: 12000

Training hyperparameters

knob	value
method	oct_behaviour
base_model	Qwen/Qwen2.5-32B-Instruct
LoRA rank	64
LoRA alpha	128
lora_dropout	0.0
learning_rate	5e-05
epochs	1.0
effective_batch	32
max_len	3072
loss_mask	last_message
grad_ckpt	True
seed	0
optimizer_steps	375
n_rows	12000
train_loss (final mean)	0.9875346412658691
folded_from (stage-1 adapter)	38538ffb83481a0f9d32c4361bb39d4e68794953aa628782e13fd784df371b4e

Provenance: behaviour spec mathematical (sha256 fd0a06bd394ab5ce), trainer implant/train_behaviour_sft.py.