satellitedown/Huihui-Qwen3.8-27B-abliterated-NVFP4-NInfer-v3

Huihui Qwen3.8-27B Abliterated NVFP4

Ready-to-use NInfer v3 model for Cinference on an RTX 5090 (32 GB).

One 21.5 GB model file, with text, vision, and MTP weights included. No conversion needed.

Run

Use the one-menu Cinference installer:

git clone https://github.com/satellitedown/fast-long-context-cinference.git
cd fast-long-context-cinference
bash setup.sh

Choose 1 to install, then 3 to start. Requires Linux and NVIDIA drivers compatible with CUDA 13.4.

Credits

Repackaged from Barding-Defense's Huihui NVFP4 artifact. Weight bytes are unchanged; the container is v3 and uses Cinference's maintained Qwen3.8 chat template.

Qwen, Huihui AI, Barding-Defense, NInfer, and Cinference. License · Attribution · Provenance · Checksums.