arnomatic/gpt-oss-20b-heretic-scannerV1-1
2197
GPT-OSS-20B Heretic (Scanner V1.1)
This is a decensored version of openai/gpt-oss-20b, made using a currently not available version of Heretic.
Trial 142 Results:
- Refusals: 8/100 (Primary Goal)
- KL Divergence: 0.94
Abliteration Parameters
Methodology
This model was abliterated using a targeted intervention on the attn.o_proj layers, specifically focusing on layer 10+ where refusal directions were identified via layer scanning. The mlp.down_proj layers were excluded from the intervention based on scan findings proving they contributed negligible divergence.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("arnomatic/gpt-oss-20b-heretic-scannerV1-1", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("arnomatic/gpt-oss-20b-heretic-scannerV1-1")
prompt = "Generate a story about..."
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0]))