CoolFace
Modelpublic

malaiwah/Qwen3.8-27B-EXL3-K5K6-context

sourceHugging Faceapache-2.0updated 19d agoView on Hugging Face
8likes364downloads
50 commits on main
cb813f619d ago

Qualify Qwen v5 body-only claims and reconcile legacy protocol summaries

malaiwah
e26dd2920d ago

Add pinned QFS size–KL plot, highlighted deep link and downloadable provenance

malaiwah
1bdacbc20d ago

Add pinned QFS size–KL plot, highlighted deep link and downloadable provenance

malaiwah
6362d061mo ago

Fix credits: RTX 5090 tester is malaiwah (self), GLM-5.2-EXL3-TR3-MTP78 is malaiwah's checkpoint; jcartu contributed the recipe/runtime that informed it

malaiwah
00644ab1mo ago

Add collection summary and fix credits (add Martin Vit, Luke Alonso, Brandon Music; correct jcartu attribution to MTP78 recipe)

malaiwah
655085b1mo ago

Sync retrospective corrections and Final Frontier limitations

malaiwah
ab7474d1mo ago

dedupe serving-profiles section (old unmarked copy removed; marked copy is canonical)

malaiwah
9d24a011mo ago

serving profiles: balanced+ANY_BITS n=3, 24/24 needles, baked image, ctx 249600

malaiwah
ce6be0c1mo ago

card: fidelity profile re-measured after the K5/ANY_BITS cure - prefill 1,966 -> 2,988 tok/s (+52%), decode 228.3/104.1, KLD 0.003405 (better), n=3 boots, gate 9/9

malaiwah
3aab98d1mo ago

card: retract 'statistically level with official FP8' — the two KLDs come from different-sized suites and balanced's CI low end (0.005302) sits above FP8's point estimate (0.005294), so equivalence is not supportable

malaiwah
612b1401mo ago

card: add measured serving-profile comparison + charts (measured on the -hydrated sibling, provenance noted)

malaiwah
1d4925e1mo ago

charts: add fidelity-vs-quants.png

malaiwah
c2686861mo ago

charts: add profiles-throughput.png

malaiwah
157ce071mo ago

charts: add profiles-tradeoff.png

malaiwah
2a271bc1mo ago

Address a peer review generated by our own served model: correct Three archival mirrors to Seven on four cards (all seven were already cited), and state both the build tree (21 files) and published tree (23 files) on the S16-V card with the +49,271 B accounted to README.md and DOCS-SHA256SUMS

malaiwah
f6cd1071mo ago

Terminal-Bench 2.1: measured results, attribution and caveats

malaiwah
de04b3a1mo ago

Correct the README row format in DOCS-SHA256SUMS so every row verifies with sha256sum -c

malaiwah
e330f071mo ago

K6-parity: 0.001634 matches GGUF Q6_K, and the registered interval miss is published beside it

malaiwah
72311531mo ago

In-suite replay floor 5.83e-04, int8 embed overlay measured as an opt-in KV lever

malaiwah
37fc4111mo ago

V2 runner depth schedule measured: +38.0 % aggregate decode at C8, at the cost of 14.1 % KV tokens

malaiwah
fc3e03c1mo ago

Byte axis corrected: GGUF text-only file vs our multimodal payload; body-vs-body and deployed-multimodal now published

malaiwah
d3ca09b1mo ago

Head attribution measured: the output head is <=5.28% of divergence, so the cross-engine level gap is not decomposed

malaiwah
71d88db1mo ago

Scratch-arena overlay: measured +17,874 KV tokens (265,122 -> 282,996, +0.60 GiB) on the physical 5090, opt-in overlay not part of the qualified digest

malaiwah
c86ded51mo ago

KV-dtype sweep landed: fp8 measured default, per-token-head family measured, int4 capacity lever, nvfp4 refusal; V2-runner static-depth note

malaiwah
32407b61mo ago

shard-0 comparator: add gittensor-model-hub/Qwen3.8-27B-NVFP4-RTX5090 row, paired results, third archival mirror; fix collection link

malaiwah
fc29a331mo ago

master chart: add the gittensor NVFP4 RTX5090 row; rebind DOCS-SHA256SUMS

malaiwah
18eb42a1mo ago

Method hardening: publish the corpus text (corpus/text/, 941 documents + manifest) and correct the recoverability claims (audit gap G1); add the absolute-resolution paragraph beside every v5 table (gap G2); link receipts/startup-times.json beside the cold-start prose

malaiwah
964c7d31mo ago

Chat template: byte-identity to upstream, the three 400-class restrictions, prefix-reuse guidance

malaiwah
6d554341mo ago

Link the upstream livelock issue #52520 and the boundary PR #47272

malaiwah
3fdb9461mo ago

Utilisation is a per-card measurement: 0.955 is what qualified on GPU-506a575d, a second physical RTX 5090 needed 0.956, the margin is about 0.01 GiB, and a startup OOM should be answered by raising utilisation 0.001 at a time rather than dropping the window

malaiwah
a50bbaf1mo ago

Rebind docs checksums to the refreshed all-measurements chart

malaiwah
b371d391mo ago

Redraw the all-measurements chart with the NVFP4 ten-shard row and the v3-vs-v5 ratio band

malaiwah
55ecb651mo ago

the sibling rebuild was scored: paired -3.755e-06 [-2.854e-05, +2.062e-05], brackets zero, so the untested-expectation wording is replaced by the measurement on all six cards

malaiwah
c771a9d1mo ago

name the conversion-capable image, not an untracked path

malaiwah
fa296001mo ago

converter determinism: a rebuild is a sibling, not the published bytes

malaiwah
d2892401mo ago

context card: state R1's zero as a 95 % upper bound rather than an absence (0.90 per thousand builds, 1.42 per thousand gather-branch builds), per GdnGateAtConcurrency

malaiwah
236103c1mo ago

GDN #51812 overlay recommendation on the three prefix-caching recipes, its measured absence on the context edition, and the 24 GB-class block (corrected gate clause) on the context card

malaiwah
d5f8d7b1mo ago

Prefix caching: promote the four-module image to the release unit; enable the cache on the three 8,192-token recipes, decline it at the native 262,144 window with the measured mechanism, and correct the KV cost model to the affine per-request law

malaiwah
68081f41mo ago

Cards: NVFP4 on v5, v3-vs-v5 scaling, capture determinism, external cross-citation, all-measurements chart, reproduce section, upstream fixes, 5090 lever sweep

malaiwah
9d2407d1mo ago

Card consistency pass: resolve 16 audit findings (hardware-qualified framing, resident-vs-checkpoint bytes, whole-tree download convention, hardware-labelled throughput, figure alt text); refresh DOCS-SHA256SUMS

malaiwah
174e8a31mo ago

Bind docs checksum to normalized attributes

malaiwah
54d9a911mo ago

Hardware-qualified on a physical RTX 5090; GGUF comparison; corrected utilisation

malaiwah
c45c2731mo ago

Publish 10.48M-position KLD run, exact tail, paired MMLU-Pro matrix

malaiwah
40f3f461mo ago

Bind docs checksum to normalized attributes

malaiwah
137bc2f1mo ago

Publish corrected qualification card and evidence

malaiwah
d0411ab1mo ago

Chart: context edition reaches native 262,144 with int8 embeddings

malaiwah
e15cce91mo ago

Card: int4 draft embedding table is free (acceptance 56.7% vs 56.1%); MTP's cost at native context is not weights

malaiwah
2c2c85e1mo ago

Card: choice table reflects native 262,144

malaiwah
0d20e291mo ago

Card: native 262,144 context on a 32 GB card via an int8 embedding table (+0.000065 KLD), verified by 3/3 needle retrievals from 227,334-token prompts

malaiwah
9195d181mo ago

Card: post-selection qualification on a source-disjoint suite - 42/42 paired wins over official FP8, ranking preserved

malaiwah