bernhardbrieger/Qwen3.8-27B-GPTQ-Int4
25.6k
Card refresh 2026-09-23 (phase-breakdown addendum): TTFT p50 + prefill tok/s + per-token decode (TPOT p50) in the Performance section
card + scripts refresh (2026-09-23): updated README (vLLM 0.29.0/0.95, MTP acceptance ranges, 196,608 verified context, vision verification vLLM-only); scripts refresh + vision_smoke.py added
Fix: replace placeholder path with bernhardbrieger/Qwen3.8-27B-GPTQ-Int4 in deployment + loading examples
Initial release: Qwen3.8-27B-GPTQ-Int4
