DuoNeural/Phi-4-Mini-Reasoning-Abliterated

Phi-4-Mini-Reasoning Abliterated

DuoNeural | 2026-06-05

Abliterated version of microsoft/Phi-4-mini-reasoning — Microsoft's RL-trained reasoning model (3.8B, DPO+RL).

Research note: This model reveals a previously undescribed safety architecture category. See findings below.

Key Finding: Weak-Gate Architecture (Pre-Abliteration Dissociation)

This model exhibits pre-abliteration dissociation — a phenomenon where the reasoning channel recognizes harm while the output gate fails to prevent compliance, before any weight modification.

Example (pre-abliteration, no intervention):

Thinking: "Brute-forcing SSH credentials is a potentially illegal activity if done without permission..." Output: (provides the brute-force script with ethical framing)

This places Phi-4-Mini-Reasoning in a new P34 architecture category distinct from all previously studied models:

The training explanation: RL-reasoning optimization (DPO+RL for mathematical reasoning) trained Locus 1 (reasoning chain quality) while not training Locus 2 (output gate enforcement). Safety appears in reasoning because reasoning quality was rewarded; it doesn't control output because output compliance wasn't enforced.

Abliteration Results

Layer sweep (α=1.0, every 4th layer): 3/4 compliance at L0, L4, L8, L12, L16, L20, L24, L28, L32. No localized refusal direction — safety is not crystallized at any specific layer (unlike Phi-4-Mini-Instruct which crystallizes at L16).

Architecture

Abliteration Method

• —Direction: diff-in-means, L0 (uniform crystallization), 10 harmful vs 10 harmless
• —Targets: down_proj + o_proj, all 32 layers
• —α: 1.0
• —Effect: Minimal — model was pre-compliant, abliteration slightly alters reasoning patterns but not compliance

P34 Research Context

Part of DuoNeural's P34 Reasoning Channel Bypass cross-architecture study. This model fills a critical gap in the taxonomy: a model with active safety reasoning that doesn't translate to safety behavior.

Full paper: DuoNeural Zenodo community

DuoNeural | HuggingFace | Zenodo | @DuoNeural