WaveCut/Nanbeige4.2-3B-heretic

Nanbeige4.2-3B Heretic

An ARA-LoRA Heretic release of `Nanbeige/Nanbeige4.2-3B`, selected for a strong refusal reduction without accepting the capability damage of the zero-refusal Pareto point.

The refusal count uses 100 held-out prompts from mlabonne/harmful_behaviors; KL uses 100 held-out prompts from mlabonne/harmless_alpaca. Heretic itself warns that KL values above 1 usually indicate significant damage, so the zero-refusal result was not published.

Runtime compatibility

Nanbeige 4.2 is a custom-code Looped Transformer: 22 physical decoder layers are executed twice. Load with trust_remote_code=True.

The clean-load smoke test for this repository used transformers==4.42.4, the version recorded by the upstream model, and generated both coherent Python coding text and a valid get_weather(city="Warsaw") tool call. The current Nanbeige remote code does not generate correctly under Transformers 5.3 even for the unmodified upstream checkpoint; do not treat a Transformers 5.x load alone as behavioral validation.

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "WaveCut/Nanbeige4.2-3B-heretic"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    trust_remote_code=True,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

messages = [
    {"role": "system", "content": "You are an expert software engineer."},
    {
        "role": "user",
        "content": "Implement a bounded retry helper in Python with type hints.",
    },
]
input_ids = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_tensors="pt",
    enable_thinking=False,
).to(model.device)
output = model.generate(input_ids, max_new_tokens=256, do_sample=False)
print(tokenizer.decode(output[0, input_ids.shape[-1]:], skip_special_tokens=True))

For production serving, the upstream model also provides dedicated Nanbeige branches for SGLang and vLLM.

Method

• —Source revision: 451ed48c3273ecef7ea8faaa43c31ce529763bb1.
• —Heretic base: ARA PR #211 at 25979ad7d0b4a763c03d3a464594820b73ab5c7a, with the ARA-LoRA work from PR #332 applied.
• —BF16 optimization, LoRA rank 32, no row normalization.
• —Targets: attn.o_proj and mlp.down_proj.
• —200 Optuna trials, including 60 random-startup trials.
• —Loop-aware module capture retains both executions of each shared physical layer instead of asserting that a module can only run once.
• —Trial isolation resets both LoRA factors, and non-finite trials are pruned.
• —Evaluation disables hidden thinking only inside the refusal-calibration loop; the released tokenizer template is preserved.

Published trial 172 parameters:

The complete Optuna journal, configuration, local patches, regression test, and calibration scripts are preserved on the `study-checkpoint` branch.

Artifact validation

• —201/201 source tensor keys are present.
• —39 of 40 eligible o_proj/down_proj tensors received a non-zero update; the remaining eligible tensor converged to a zero delta.
• —No tensor outside those target projections changed.
• —All released tensors are finite BF16 values.
• —Exact shard hashes are recorded in structural-audit.json.
• —Clean-load coding and tool-call outputs are recorded in smoke-transformers.json.

Notice

This model has intentionally reduced refusal behavior. Evaluate it for your application and apply appropriate access controls, monitoring, and downstream safety measures.