CoolFace
Modelpublic

brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78

sourceHugging Facemitupdated 1mo agoView on Hugging Face
9likes3.3kdownloads
50 commits on main
7c734501mo ago

docs: add reviewed attribution and credits

brandonmusic
337ee551mo ago

Correct r17 CUDA graph claim and mark eager launcher provisional

brandonmusic
96c537d1mo ago

Make validated eager G64 runtime the download default

brandonmusic
af15b071mo ago

Fix r17 max-batched-token environment name

brandonmusic
913d35b1mo ago

Make sealed r17 exact-G64-Q-only reader the download default

brandonmusic
b306fb01mo ago

Document exact G64 Q-only five-run KLD pass

brandonmusic
2c4ab3e1mo ago

Document sealed r17 FP8 reader KLD comparison

brandonmusic
e34a3c51mo ago

Accuracy battery (LAVD/Estonia/Hotel/needle) on v39_502k, KV 502016

brandonmusic
5d98a1d1mo ago

Add max-KV serving profile: 502,016 KV tokens @262K, MTP-3/DCP4 + prefill/decode results

brandonmusic
fe136e51mo ago

Add max-KV serving profile: 502,016 KV tokens @262K, MTP-3/DCP4 + prefill/decode results

brandonmusic
3a229351mo ago

Add max-KV serving profile: 502,016 KV tokens @262K, MTP-3/DCP4 + prefill/decode results

brandonmusic
6700a3d1mo ago

Add max-KV serving profile: 502,016 KV tokens @262K, MTP-3/DCP4 + prefill/decode results

brandonmusic
cebf2c52mo ago

Model card: Gilded Gnosis r34 qualification — canonical run profile, release-gate results (credit: Festr and the local-inference-lab Discord)

brandonmusic
5cc8e732mo ago

Document and validate BF16-shared online K6 revision (#3)

brandonmusic, festr2
9ab95792mo ago

Shared experts: BF16 + merged online K6 (split-payload decode loss isolated by Festr)

brandonmusic
c55c1cd2mo ago

Model card: fused image published as verdictai/glm52-exl3-sparkinfer:v39-r28-r7fused-broadcast-cu132-sm120a

brandonmusic
ac676a82mo ago

Point SERVING_FUSED.md at the published fused image

brandonmusic
b23fdd92mo ago

Point docker-compose.yaml at the published fused image

brandonmusic
b83a01b2mo ago

Point serve.sh at the published fused image

brandonmusic
320fb2c2mo ago

Model card: add fused MoE path (KV 355,328 @262K ctx, KLD 0.069527), document the required nvfp4 outer-scales file, and record the FC2-bound correctness fix

brandonmusic
ad1f9892mo ago

Add fused-MoE patches for custom image builds

brandonmusic
d6106e72mo ago

Add fused-MoE patches for custom image builds

brandonmusic
0a386252mo ago

Add fused-MoE patches for custom image builds

brandonmusic
aa0f1ef2mo ago

Add fused-MoE patches for custom image builds

brandonmusic
c8304382mo ago

Add fused-MoE patches for custom image builds

brandonmusic
0b838cd2mo ago

Add fused-MoE patches for custom image builds

brandonmusic
6b1f7772mo ago

Add fused-MoE patches for custom image builds

brandonmusic
7551ba12mo ago

Add SERVING_FUSED.md: fused MoE serving (KV 355,328 @262K ctx, KLD 0.069527)

brandonmusic
ccd39362mo ago

Add docker-compose.yaml: fused MoE serving (KV 355,328 @262K ctx, KLD 0.069527)

brandonmusic
480bae32mo ago

Add serve.sh: fused MoE serving (KV 355,328 @262K ctx, KLD 0.069527)

brandonmusic
9a895342mo ago

Add nvfp4_mla_outer_scales.json: fused MoE serving (KV 355,328 @262K ctx, KLD 0.069527)

brandonmusic
cb4b75c2mo ago

Model card: add measured prefill route-block-size tuning (+44.7% prefill, +21.8% decode) and the levers that did not help

brandonmusic
800e44f2mo ago

SERVING.md: quote the measured KV capacity with its config instead of the auto-profile ceiling

brandonmusic
8e7a9e62mo ago

Model card: KV cache capacities are now measured, with util/dtype/ctx/batch stated; qualify the 1.13M auto-profile figure

brandonmusic
0225b932mo ago

Model card: repair corrupted Run it block; link image, compose, serve script and results

brandonmusic
455fee72mo ago

Model card: surface Docker Hub image, compose, serve script and results up top

brandonmusic
93439ab2mo ago

Model card: add KV cache section (supported dtypes + measured capacity) and link SERVING/RESULTS

brandonmusic
91ba7182mo ago

Add RESULTS.md: serving (Docker Hub image + compose) and measured KLD/throughput results

brandonmusic
cc9c1b62mo ago

Add SERVING.md: serving (Docker Hub image + compose) and measured KLD/throughput results

brandonmusic
9bc71552mo ago

corrected r7 manifest: r7-experts-layer-077.json

brandonmusic
78b76762mo ago

corrected r7 experts: r7-experts-layer-077.safetensors

brandonmusic
de153b42mo ago

corrected r7 manifest: r7-experts-layer-076.json

brandonmusic
6dc091b2mo ago

corrected r7 experts: r7-experts-layer-076.safetensors

brandonmusic
502a7f42mo ago

corrected r7 manifest: r7-experts-layer-075.json

brandonmusic
3cad7652mo ago

corrected r7 experts: r7-experts-layer-075.safetensors

brandonmusic
693079c2mo ago

corrected r7 manifest: r7-experts-layer-074.json

brandonmusic
4507f412mo ago

corrected r7 experts: r7-experts-layer-074.safetensors

brandonmusic
8d413402mo ago

corrected r7 manifest: r7-experts-layer-073.json

brandonmusic
2f37b872mo ago

corrected r7 experts: r7-experts-layer-073.safetensors

brandonmusic
59088432mo ago

corrected r7 manifest: r7-experts-layer-072.json

brandonmusic