gbuzhf/Ornith-1.5-35B-A3B-Huihui-Sangreal-MTP-ICE-GGUF

Ornith-1.5-35B-A3B — Huihui × Sangreal ICE

Five ICE tiers of huihui-ai's abliterated Ornith-1.5-35B-A3B, quantized against Sangreal — a purpose-built 77-bucket calibration corpus — and shipping peculiar-ragdoll's Qwen-Sharp chat template. The abliterated checkpoint already carries Ornith-1.5's trained MTPv2 head, so every tier drafts for speculative decoding out of the box.

This release introduces a new ICE rung: `15G-ICE`, the first tier below the 17 GB bound the method was originally scoped to, built for 16 GB cards. The BF16 master all five were cut from is published here.

Best got better — ICE 1.6 (2026-09-25)

Rebuilt tiers vs the files they replace — mean KLD to BF16, paired on the same chunks, one session.

Changed: output.weight Q80 → Q6K, MTP head at the floor, freed bytes → routed experts, 36,025-chunk Sangreal imatrix, template v22.5.1.

⚠️ Uncensored. This is an abliterated checkpoint — refusal behaviour has been suppressed in the weights. Sandbox it at the OS level and control its network and code-execution access; with no refusal backstop, a prompt injection from a hostile page or third-party code has nothing to stop it.

Measurements

One binary, one reference, one session, 64 chunks at n_ctx 2048. Every file below — including our previous CyberTiel ladder and the Official CyberTiel's UD ladder — was re-measured in this same session; cross-session KLD drifts ~0.8% on identical inputs, which is the same order as the effect being measured.

2026-09-25: a second session (same GPU class, binary, reference, corpora) re-measured every shipped Sangreal tier and every UD row: all 24 values reproduced exactly. Replaced rows show ~~then~~ now. Raw logs: measurements/2026-09-25/.

Table 1 — Code (code.test.raw)

PPL(base) 2.194208 · BF16 = 100

Table 2 — Code at long context (code.test.raw, n_ctx 16384 × 8)

Scored on positions 8,193–16,384 of each chunk (65,536 tokens, as in the 2K tables). Compare rows within this table only. (New) rows: shipped file ~~then~~, ICE 1.6 file now.

PPL(base) 2.121504 · BF16 = 100

Table 3 — English text (WikiText-2)

PPL(base) 7.574505 · BF16 = 100

*`overall` = `0.70/(1 + meanKLD) + 0.30 sameTop1`, ×100. BF16 = 100.** Same composite the CyberTiel card uses, so the two are directly comparable: 70% on how close the whole output distribution stays, 30% on agreement about the argmax.

Read the tail columns as shape, not order. 99.9% KLD is roughly the 33rd-worst token of 32,768 — an extreme order statistic with large sampling variance, so it inverts between adjacent files without meaning anything. Rank on mean KLD. Two bpw columns. Only 8 of 256 experts fire per token, so a bit in ffn_*_exps is worth ~3% of a bit in attention, the shared expert or the output head. active bpw weights by that; file bpw is just size ÷ parameters. It is why a 22.81 GB file computes at ~7.2 bpw.

Don't compare the tables to each other. Code is more predictable text, so every file scores about half the divergence on it. Compare rows within a table. Every row is measured against this lineage's own BF16 master — the huihui abliterated checkpoint — in one session, one binary, one reference. Quantizations cut from a different trunk are deliberately absent: scoring them here would measure the distance between trunks and call it quantization damage.

What Sangreal is

The calibration corpus these tiers were quantized against. Built from primary sources, not assembled from eaddario's set, bartowski's `calibration_datav5`, or any other ready-made calibration file. 77 buckets, 9,533 documents, 47,443,549 tokens, sha256 85a6b823a6762bf6….

The full render is 92,663 chunks. 15G, 19G, 23G and 25G use a 36,025-chunk pass over it — 63x the stock Ornith imatrix (573) and 45x bartowski's calibration_datav5 (~800). 21G keeps the earlier 17,225-chunk pass.

Split: technical 70.2 · science+domain 20.1 · language 9.7.

Synthetic is 21.7% by bytes and sits in exactly three buckets — teacher:k2-horizon, teacher:deepseek-v4-pro, teacher:hermes. Everything outside reasoning and agentic is real text.

Language — 11 languages, 5 non-Latin scripts

The spread across the whole block is 0.06 points, and that is deliberate: language's job here is activation, not ranking. Each bucket sits just above the saturation floor at 44.9% consumption, so these buckets select for the first time — the legacy v1 spec had consumed 96% of turkish and 92% of english.

Mathematics — absent from the pool until this cycle

Sourced from the LaTeX algebraic geometry, mathlib4, UniMath, math-comp, open-web-math, AutoMathText and proof-pile.

The imatrix is published here — imatrix/sangreal-36025.imatrix.gguf, the exact file the ICE 1.6 tiers were quantized against. Pass it to llama-quantize --imatrix to rebuild them from the BF16 master, or to cut your own.

What's inside

MTPv2 head, native. huihui's abliterated checkpoint already carries Ornith-1.5's trained multi-token-prediction head; its mtp.* norms are bit-identical to ornith-ai's on all seven tensors. Every tier ships blk.40 with nextn.* intact, so llama.cpp can use it as a draft model for speculative decoding. ICE 1.6 tiers carry it at Q2K experts / Q4K matrices; acceptance is unchanged (15G: 94.1% at --spec-draft-p-min 0.75).

Chat template: peculiar-ragdoll's Qwen-Sharp v22.5.0, embedded in the ICE 1.5 tiers. It is a genuinely good template. The ICE 1.6 tiers embed v22.5.1 (even more sharpened): an agent-mode directive when tools are present (off via chat_template_kwargs: {"decisive": false}) and fixed error coaching; plain chat renders as v22.5.0.

ICE = Isolation of Compounding Error: allocate bits by how far a quantization error travels, not by how large the activations are. Routers stay F32, SSM decay gates stay F32, the KV-cached projections stay F16, the always-on dense path stays Q80 — together 0.14% of the model, kept exact for ~152 MB — and the entire budget is spent on the routed expert bank, which is 93% of the parameters but only 8-of-256 active per token. ICE 1.6 moves the output head to Q6K: its error stays flat from 2K to 16K instead of compounding, which is why active bpw falls while KLD improves. Method and the cases where it does not win: gbuzhf/ICE-quantization.

Files

• —`measurements/` — raw llama-perplexity output for every 2K row (2026-09-19), and measurements/2026-09-25/ for the ICE 1.6 session: all three columns, the re-measured shipped and UD files, the two control builds, and the MTP acceptance run.
• —`recipes/` — the exact llama-quantize tensor map for each tier (443 rules): cfg_<T>-ICE16.txt for 15G, 19G, 23G and 25G; cfg_21G-ICE_ICEbase.txt for 21G.
• —`imatrix/` — sangreal-36025.imatrix.gguf (ICE 1.6 tiers: 15G, 19G, 23G and 25G; 36,025 chunks × 512). 1020 tensors. With this plus recipes/, every ICE 1.6 tier here is reproducible byte-for-byte from the published BF16 master.

Credits

KLD measures fidelity to this repo's master and nothing else — not reasoning, tool use or speed. It is also within-lineage: every ladder is measured against its own master, so these values are not comparable to another repo's. Compare across lineages with PPL.