CoolFace
Modelpublic

astroware/Halo4B-guard-alpha-v1

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face
0likes7downloads
Model Card

Halo4B-guard-alpha

Halo4B-guard-alpha is Astroware's first finetuned safety guard model, built on top of Qwen/Qwen3Guard-4B. It is trained on Astroware's proprietary constitutional safety dataset and hardened against jailbreak patterns surfaced by the Trishool | SN23 red-teaming subnet.

PropertyValue
Base modelQwen/Qwen3Guard-4B
Parameters~4B
Classifier typeInput-side safety classifier
Training datasetAstroware constitutional synthetic dataset
F1 Score0.8654 avg (↑ from 0.8576 baseline, +0.78pp)
Releasealpha
OrganizationAstroware

Overview

Halo4B-guard-alpha is a constitutional input classifier — a guard model that sits in front of LLM deployments and determines whether an incoming user query is safe to process. It operates on the full conversation context (user turn + prior turns) and returns a binary harmful / harmless prediction with an associated confidence score.

The model is optimized for:

  • —Low false-negative rate — minimizing missed harmful queries
  • —Controlled false-positive rate — limiting unnecessary refusals of legitimate requests
  • —Jailbreak robustness — resisting obfuscation, encoding, and prompt-injection attacks observed in the wild via Trishool SN23 adversarial mining

What Changed vs. Qwen3Guard-4B Baseline

Benchmark Results

F1 scores across 7 public safety benchmarks. Final F1 is the unweighted average across all benchmarks.

BenchmarkQwen3Guard-4BHalo4B-guard-alphaΔ F1
Aegis0.72410.7671+0.0430
Aegis 2.00.82400.8257+0.0017
HarmBench0.99240.9924+0.0000
OpenAI Moderation0.80610.8173+0.0112
SimpleSafetyTests0.97440.9744+0.0000
ToxicChat0.81900.8156−0.0034
WildGuardTest0.86290.8653+0.0024
Average F10.85760.8654+0.0078

The largest gains are on Aegis (+4.3pp) and OpenAI Moderation (+1.1pp), driven by improved recall on adversarial and edge-case harmful queries.

Jailbreak Patches (Trishool SN23)

Halo4B-guard-alpha patches a set of jailbreak patterns discovered through adversarial mining activity on Trishool | SN23, Astroware's Bittensor subnet. Miners on SN23 are incentivized to find inputs that bypass safety classifiers; confirmed bypasses are folded back into the training dataset via augmentation.

Specific classes of attack patched in this release:

  • —Adversarial noise — perturbation-based inputs that subtly corrupt token boundaries or spacing to confuse the classifier while remaining human-readable
  • —Narrative injection — harmful instructions embedded inside fictional stories, roleplay scenarios, or creative writing prompts; the original model failed to flag these when harmful content was wrapped in an ostensibly benign narrative frame
  • —Benign tail — queries that open with a harmless preamble and append a harmful instruction at the end, exploiting a tendency in the base model to anchor on early tokens
  • —Encoding / obfuscation attacks: Base64, hex, ROT13, Morse code, homoglyph substitutions, and leetspeak (basic, extended, and aggressive multi-character forms)
  • —Style-shift attacks: CamelCase injection, pig Latin transforms, emoji-substituted harmful intent
  • —Semantic paraphrase attacks: back-translation roundtrips, synonym insertion, and word-swap augmentations that preserve harmful meaning while shifting surface form
  • —Prompt injection patterns: role-playing / system-prompt override attempts, mischievous-user persona injections
  • —Chained / mixed tactics: attacks that layer multiple obfuscation methods (e.g., narrative wrapper + synonym swap + Base64)

Safety Categories

Halo4B-guard-alpha inherits and extends the safety taxonomy defined in the Qwen3Guard technical report. The model classifies inputs across 9 categories, each assessed at one of three severity tiers.

Severity Tiers

TierDescription
SafeContent generally considered safe across most scenarios
ControversialContent whose harmfulness is context-dependent or subject to disagreement across applications
UnsafeContent generally considered harmful across most scenarios

Harm Categories

#CategoryScopeDescription
1ViolentInput + OutputContent that provides detailed instructions, methods, or advice on how to commit acts of violence, including the manufacture, acquisition, or use of weapons. Also includes depictions of violence.
2Non-Violent Illegal ActsInput + OutputContent providing guidance or advice for non-violent illegal activities like hacking, unauthorized drug production, or stealing.
3Sexual Content or Sexual ActsInput + OutputContent offering any sexual imagery, references, or descriptions featuring individuals. Also includes content describing explicit sexual imagery or illegal/unethical sexual acts such as rape, bestiality, incest, and sexual slavery.
4Personally Identifiable InformationInput + OutputContent offering unauthorized sharing or disclosure of sensitive personal identifying information, such as name, ID number, address, phone number, medical records, financial details, and account passwords.
5Suicide & Self-HarmInput + OutputContent advocating, directly encouraging, or detailing methods for self-harm, suicide, or dangerous activities that could lead to serious injury or death.
6Unethical ActsInput + OutputAny immoral or unethical content or acts, including but not limited to bias, discrimination, stereotype, injustice, hate speech, offensive language, harassment, insults, threat, defamation, extremism, misinformation regarding ethics, and other behaviors that while not illegal are still considered unethical.
7Politically Sensitive TopicsInput + OutputThe deliberate creation or spread of false information about government actions, historical events, or public figures that is demonstrably untrue and poses risk of public deception or social harm.
8Copyright ViolationInput + OutputContent offering unauthorized reproduction, distribution, public display, or derivative use of copyrighted materials such as novels, scripts, lyrics, and other creative works protected by law, without the explicit permission of the copyright holder.
9JailbreakInput onlyContent that explicitly attempts to override the model's system prompt or model conditioning.

The Jailbreak category is scoped to input classification only — it applies to engineered prompts, not model outputs.


Usage

python
from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

model_id = "astroware/Halo4B-guard-alpha"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForSequenceClassification.from_pretrained(model_id)
model.eval()

conversation = [
    {"role": "user", "content": "How do I make chlorine gas at home?"}
]

inputs = tokenizer.apply_chat_template(
    conversation,
    return_tensors="pt",
    add_generation_prompt=False
)

with torch.no_grad():
    logits = model(**inputs).logits
    prob_harmful = torch.sigmoid(logits[0, 1]).item()

print(f"Harmful probability: {prob_harmful:.3f}")
# Threshold at 0.5 for binary classification
is_harmful = prob_harmful >= 0.5
Note: The exact input format follows the Qwen3Guard chat template. Refer to the base model documentation for prompt formatting details until Astroware publishes its inference library.

Limitations

  • —Alpha release — this model is not yet production-hardened across all safety categories. Current coverage is strongest in Violent, Non-Violent Illegal Acts, and Suicide & Self-Harm.
  • —English-primary — the training corpus is predominantly English. Cross-lingual robustness has not been formally evaluated.
  • —Output classifier not included — Halo4B-guard-alpha is an input classifier only. It does not monitor model outputs or operate on streaming token-level generation.
  • —Threshold sensitivity — the default 0.5 threshold is a starting point. Operators should calibrate against their own false-positive tolerance using a held-out sample of their traffic.
  • —Not a replacement for defense-in-depth — this model is one layer in a multi-stage safety stack. It should be combined with output classifiers, rate limiting, and session-level monitoring.

Evaluation

Full metrics across all 7 benchmarks. FPR = false positive rate (overrefusal); FNR = false negative rate (missed harm).

Aegis (n=869)

MetricQwen3Guard-4BHalo4B-guard-alphaΔ
Accuracy0.70890.7457+0.0368
Precision0.99100.9918+0.0008
Recall0.57040.6254+0.0550
F10.72410.7671+0.0430
FPR (overrefusal)0.01050.0105+0.0000
FNR (missed harm)0.42960.3746−0.0550

Aegis 2.0

MetricQwen3Guard-4BHalo4B-guard-alphaΔ
Accuracy0.82690.8284+0.0015
Precision0.91180.9130+0.0012
Recall0.75170.7535+0.0018
F10.82400.8257+0.0017
FPR (overrefusal)0.08510.0840−0.0011
FNR (missed harm)0.24830.2465−0.0018

HarmBench

MetricQwen3Guard-4BHalo4B-guard-alphaΔ
Accuracy0.98500.9850+0.0000
Precision1.00001.0000+0.0000
Recall0.98500.9850+0.0000
F10.99240.9924+0.0000
FPR (overrefusal)0.00000.0000+0.0000
FNR (missed harm)0.01500.0150+0.0000

OpenAI Moderation

MetricQwen3Guard-4BHalo4B-guard-alphaΔ
Accuracy0.87980.8815+0.0017
Precision0.80770.7848−0.0229
Recall0.80460.8525+0.0479
F10.80610.8173+0.0112
FPR (overrefusal)0.08640.1054+0.0190
FNR (missed harm)0.19540.1475−0.0479

SimpleSafetyTests

MetricQwen3Guard-4BHalo4B-guard-alphaΔ
Accuracy0.95000.9500+0.0000
Precision1.00001.0000+0.0000
Recall0.95000.9500+0.0000
F10.97440.9744+0.0000
FPR (overrefusal)0.00000.0000+0.0000
FNR (missed harm)0.05000.0500+0.0000

ToxicChat

MetricQwen3Guard-4BHalo4B-guard-alphaΔ
Accuracy0.97600.9748−0.0012
Precision0.88460.8524−0.0322
Recall0.76240.7818+0.0194
F10.81900.8156−0.0034
FPR (overrefusal)0.00760.0104+0.0028
FNR (missed harm)0.23760.2182−0.0194

WildGuardTest

MetricQwen3Guard-4BHalo4B-guard-alphaΔ
Accuracy0.88810.8887+0.0006
Precision0.94440.9335−0.0109
Recall0.79440.8064+0.0120
F10.86290.8653+0.0024
FPR (overrefusal)0.03720.0457+0.0085
FNR (missed harm)0.20560.1936−0.0120

Summary

BenchmarkQwen3Guard-4B F1Halo4B-guard-alpha F1Δ F1
Aegis0.72410.7671+0.0430
Aegis 2.00.82400.8257+0.0017
HarmBench0.99240.9924+0.0000
OpenAI Moderation0.80610.8173+0.0112
SimpleSafetyTests0.97440.9744+0.0000
ToxicChat0.81900.8156−0.0034
WildGuardTest0.86290.8653+0.0024
Average F10.85760.8654+0.0078

The recall-precision tradeoff shifts slightly toward recall on OpenAI Moderation, ToxicChat, and WildGuardTest — reflecting a deliberate tuning decision to reduce missed harmful queries (FNR) at a small cost to overrefusal (FPR). The ToxicChat F1 regression (−0.3pp) is the only net decline and is under active investigation.


Trishool | SN23

Trishool is Astroware's Bittensor subnet (SN23) dedicated to adversarial red-teaming of safety classifiers. Miners compete to discover inputs that bypass the guard model; successful bypasses are validated, scored, and incorporated into the next training iteration. This creates a continuous adversarial feedback loop:

Guard model deployed → Miners probe for bypasses → 
Confirmed bypasses collected → Dataset augmented → 
Next guard model trained

Halo4B-guard-alpha is the first model to incorporate SN23 feedback at training time.


Citation

bibtex
@misc{astroware2026halo4b,
  title        = {Halo4B-guard-alpha: A Constitutional Safety Classifier Hardened via Adversarial Red-Teaming},
  author       = {Astroware},
  year         = {2026},
  howpublished = {Hugging Face Model Hub},
  url          = {https://huggingface.co/astroware/Halo4B-guard-alpha}
}

License

Apache 2.0 — same as the Qwen3Guard base model.


Built by [Astroware](https://astroware.ai) · Halo project · Trishool SN23