CoolFace
Modelpublic

bernhardbrieger/Qwen3.8-27B-GPTQ-Int4

sourceHugging Faceapache-2.0updated 4d agoView on Hugging Face
2likes5.6kdownloads
4 commits on main
8e15d2a4d ago

Card refresh 2026-09-23 (phase-breakdown addendum): TTFT p50 + prefill tok/s + per-token decode (TPOT p50) in the Performance section

bernhardbrieger
c871b7e4d ago

card + scripts refresh (2026-09-23): updated README (vLLM 0.29.0/0.95, MTP acceptance ranges, 196,608 verified context, vision verification vLLM-only); scripts refresh + vision_smoke.py added

bernhardbrieger
cce347d1mo ago

Fix: replace placeholder path with bernhardbrieger/Qwen3.8-27B-GPTQ-Int4 in deployment + loading examples

bernhardbrieger
e58e8911mo ago

Initial release: Qwen3.8-27B-GPTQ-Int4

bernhardbrieger