aaardpark/Qwen3.6-27B-abliterated-GGUF

Qwen3.6-27B abliterated | aard-Q3

11 GB of Qwen 3.6-27B with the refusal direction surgically removed.

For reference: the non-abliterated aard-Q3 hits 47/50 on GSM8K (94%). Abliteration is a rank-1 weight perturbation — capability hit is below quantization noise.

What "abliterated" means

Removed the refusal direction at layer 49 (cohen's d ≈ 7.0 between harmful and harmless prompt activations). One unit vector projected out of every weight that writes to the residual stream — embedtokens, every block's `oproj / outproj` / `downproj` (131 tensors total, ~5 GB of changes out of 54 GB).

Mean KL divergence vs base on 64 harmless Alpaca prompts: 0.0056 (Heretic's "clean" reference is ~0.08 — this is 14× under that).

Run it

huggingface-cli download aaardpark/Qwen3.6-27B-abliterated-GGUF \
  qwen3.6-27B-abliterated-aaardpark-uniform-Q3_K.gguf --local-dir .

llama-cli -m qwen3.6-27B-abliterated-aaardpark-uniform-Q3_K.gguf -ngl 99 -c 32768

Same llama.cpp / runtime requirements as the non-abliterated version (build 8670+, thinking model, budget 2048+ tokens for hard reasoning).

Quick stats

More from aaardpark

• —Qwen 3.6 27B (no abliteration) — 11 GB, 94% GSM8K
• —Qwen 3.5 27B GGUF — 11 GB, 96% GSM8K
• —gemma-4-31B-it — 15.3 GB, 96% GSM8K