Modelpublic

SargeDev/Jev_Qwen3.8-27B

sourceHugging Faceapache-2.0updated 3d agoView on Hugging Face

0likes10downloads

Model Card

Jev_Qwen3.8-27B

A full bf16 merge of huihui-ai/Huihui-Qwen3.8-27B-abliterated + a QLoRA adapter trained on SargeDev/jev-distill-corpus-v3 — 45,000 natural-language judgment rows distilled from the 741k-row calibrated typed-decision corpus (noul / choice / score).

What it's tuned to do

Give brief, calibrated judgments: state a call, attach an honest confidence, and say plainly when something is a genuine toss-up. Everyday decision-making style — crisp calls instead of hedging, honest uncertainty instead of fake confidence.

Example behaviors after the tune (vs the same base zero-shot): calibrated yes/no and multi-option spreads measurably closer to ground-truth targets on held-out corpus rows, with the base's general capabilities intact (LoRA merge, rank 64).

Training

—Base: huihui-ai/Huihui-Qwen3.8-27B-abliterated (bf16)
—Method: QLoRA — 4-bit NF4 (double quant), r=64, alpha=128, pagedadamw8bit, completion-only loss
—Data: 45k rows, NL-phrased, stratified by kind and family, disjoint from the JSON-judge split
—900 steps (~26k rows), cosine to zero, single epoch
—Trained on an NVIDIA GB10 (DGX Spark-class)

Usage

Chat template: Qwen3.5-style. The model was trained with thinking disabled (enable_thinking=false) — for its tuned behavior, serve with thinking off. Thinking on still works but produces a think block first.

python

from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("SargeDev/Jev_Qwen3.8-27B")
model = AutoModelForCausalLM.from_pretrained("SargeDev/Jev_Qwen3.8-27B", torch_dtype="bfloat16", device_map="auto")

Credits

—Quant base: huihui-ai (Huihui-Qwen3.8-27B-abliterated)
—Corpus + distillation: SargeDev/jev-distill-corpus-v3 (local-inference-lab / TypeSafe System One schema)
—Upstream: Qwen team

Apache-2.0.