CoolFace
Modelpublic

pottokao/Qwen-Image-2.1-DiT-GGUF

sourceHugging Faceotherupdated 3d agoView on Hugging Face
1likes7.1kdownloads
Model Card

Qwen-Image-2.1 DiT — GGUF (Q80 · Q6K · Q4KM)

Not affiliated with, or endorsed by, Alibaba / Qwen. Quantized redistribution of the `Qwen/Qwen-Image-2.1` diffusion transformer under the Qwen Research License (copy included as LICENSE). Non-commercial use only.
[!IMPORTANT] Loads in stock [city96/ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF) — no patch, no extra nodes. These files carry general.architecture = qwen_image, so UnetLoaderGGUF recognises them directly (GGUFs without that field fail with Unknown model architecture!). Text encoder: our Qwen-Image-2.1 Text Encoder GGUF works with this DiT, but it needs one extra node first — ComfyUI-GGUF-Qwen3VL-TE (stock ComfyUI-GGUF doesn't load Qwen3-VL text encoders yet). With a safetensors text encoder (bf16 / int8 / FP8 from the same repo family) nothing extra is needed.

Made with a simple node

The sample / showcase images in this repo were generated with the technique behind [ComfyUI-QwenImage-PhotoStyles](https://github.com/pottokao-dotcom/ComfyUI-QwenImage-PhotoStyles) — a small ComfyUI node (17 photographic styles; one short prompt becomes a full styled prompt via the PE-T2I rewriter). If you're interested in how the images are made, the node and its recipe are there.

Where are the prompts? The node is applied up front as the PE-T2I step — you type one short line and it expands it into the full prompt. The exact short prompts live in that repo's Gallery: the line printed under each image there is the literal prompt (copy it verbatim), not a description of the picture.

📥 Files

FileSizeFor
qwen_image_2.1-Q8_0.gguf7.69 GBclosest to bf16
qwen_image_2.1-Q6_K.gguf6.00 GBnearly identical to Q8_0 in our test
qwen_image_2.1-Q4_K_M.gguf4.34 GBrecommended — smallest; small detail changes vs Q8_0

Put one in ComfyUI/models/diffusion_models/ (or models/unet/) and load it with `UnetLoaderGGUF`. Needs ComfyUI 0.36.0 or newer (for TextEncodeQwenImage21).

🖼️ Showcase

<table> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/01.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/01.jpg" width="100%"></a><br><sub>Warm Documentary</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/02.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/02.jpg" width="100%"></a><br><sub>Candid B&W Street</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/04.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/04.jpg" width="100%"></a><br><sub>Vivid Everyday Color</sub></td></tr> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/05.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/05.jpg" width="100%"></a><br><sub>Black Fury</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/06.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/06.jpg" width="100%"></a><br><sub>Geometry of Light</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/07.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/07.jpg" width="100%"></a><br><sub>Frozen Film Still</sub></td></tr> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/08.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/08.jpg" width="100%"></a><br><sub>Deadpan Large-Format</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/09.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/09.jpg" width="100%"></a><br><sub>White Leap</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/10.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/10.jpg" width="100%"></a><br><sub>Corner Elegance</sub></td></tr> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/11.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/11.jpg" width="100%"></a><br><sub>Raw B&W Fashion</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/12.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/12.jpg" width="100%"></a><br><sub>Color Behind Glass</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/13.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/13.jpg" width="100%"></a><br><sub>High-Contrast Reportage</sub></td></tr> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/14.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/14.jpg" width="100%"></a><br><sub>Lyrical Landscape</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/15.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/15.jpg" width="100%"></a><br><sub>Hyper Chic East</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/16.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/16.jpg" width="100%"></a><br><sub>Street in the Mirror</sub></td></tr> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/18.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/18.jpg" width="100%"></a><br><sub>Plain Portrait</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/19.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/19.jpg" width="100%"></a><br><sub>Melancholy B&W</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/20.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/20.jpg" width="100%"></a><br><sub>Fairytale Giants</sub></td></tr> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/21.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/21.jpg" width="100%"></a><br><sub>Cold Power</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/22.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/22.jpg" width="100%"></a><br><sub>Cold Power</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/23.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/23.jpg" width="100%"></a><br><sub>Hyper Chic East</sub></td></tr> <tr><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/24.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/24.jpg" width="100%"></a><br><sub>Fairytale Giants</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/25.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/25.jpg" width="100%"></a><br><sub>Hyper Chic East</sub></td><td width="33%"><a href="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/blob/main/showcaseassets/26.jpg"><img src="https://huggingface.co/pottokao/Qwen-Image-2.1-DiT-GGUF/resolve/main/showcaseassets/26.jpg" width="100%"></a><br><sub>White Leap</sub></td></tr> </table>

This is what Q4_K_M across the board looks like — every image above was made with:

PartFile
PE-T2I rewriter`pe_t2i_heretic-Q4_K_M.gguf`
Text encoder`qwen3vl_8b_heretic-Q4_K_M.gguf` + f16 mmproj
DiT`qwen_image_2.1-Q4_K_M.gguf`
VAEqwen_image_2.1_vae_bf16.safetensors (official)

<sub>AI-generated. Style homage only — not affiliated with or endorsed by the photographers.</sub>

🍱 All-GGUF Qwen-Image-2.1

The whole pipeline can run on GGUF — useful on Macs and smaller GPUs:

PartFileWhereLoader
Prompt rewriter (optional)pe_t2i_heretic-Q4_K_M.gguf + system_prompt.txtPE-T2I Heretic GGUFllama.cpp / LLM node
Text encoderqwen3vl_8b_heretic-Q4_K_M.gguf + mmproj-…-f16.ggufText Encoder Heretic GGUFCLIPLoaderGGUF + patch node (until ComfyUI-GGUF supports Qwen3-VL)
DiTqwen_image_2.1-Q4_K_M.gguf (or Q6K / Q80)this repoUnetLoaderGGUF — stock
VAEqwen_image_2.1_vae_bf16.safetensors (official)—VAELoader

Prefer no patch at all? Use a safetensors text encoder instead (e.g. bf16 or int8-convrot) with the stock CLIPLoader.

⚙️ Recommended sampler settings

25 steps, euler / simple. For images with text (signs, posters, labels), switch cfg partway through with two KSamplerAdvanced nodes — the first 15 steps at cfg 1 lock in composition and materials, the last 10 at cfg 3 with a negative prompt redraw the lettering:

`add_noise``steps``cfg``start_at_step``end_at_step``return_with_leftover_noise`
1stenable251.0012–17enable
2nddisable253.012–1725disable

Example negative prompt: oversaturated, overexposed, gibberish text. Without text, a single KSampler at cfg 1.0 is fine.

Quantization

Standard ComfyUI-GGUF image-model rules — no per-layer sensitivity scan:

TensorsQ4_K_MQ6_KQ8_0
img_in, txt_in, time_text_embed, norm_out, proj_out, modulationBF16 (kept)BF16 (kept)BF16 (kept)
attn.to_v (×32 blocks)Q6_KQ6_KQ8_0
attn.to_q / to_k / to_out, img_mlp.gate_up / outQ4_KQ6_KQ8_0
normsF32F32F32

How it was made (reproducible)

Converted from the official bf16 weights (ComfyUI layout, 265 tensors) with ComfyUI-GGUF's own tooling. Neither its convert.py nor its patched llama.cpp knew Qwen-Image, so both got a small addition — the patches are in `tools/`:

  • —tools/convert-qwen_image.patch — adds a qwen_image template to convert.py (7 lines)
  • —tools/llama.cpp-b3962-qwen_image.patch — ComfyUI-GGUF's lcpp.patch plus a qwen_image architecture and its keep-in-BF16 list
bash
# ComfyUI-GGUF's tools/ with tools/convert-qwen_image.patch applied
python tools/convert.py --src qwen_image_2.1_bf16.safetensors --dst qwen_image_2.1-BF16.gguf
# llama.cpp at tag b3962 with tools/llama.cpp-b3962-qwen_image.patch applied
llama-quantize qwen_image_2.1-BF16.gguf qwen_image_2.1-Q4_K_M.gguf Q4_K_M   # also Q6_K, Q8_0

Verified

On ComfyUI 0.36.0 + ComfyUI-GGUF 6ea2651 (NVIDIA GPU):

  • —Stock loader — ComfyUI started with only ComfyUI-GGUF enabled (every other custom node disabled): all three files load through UnetLoaderGGUF with no compatibility-mode warning and generate normally. In that test (one prompt, one seed), they give near-identical images; Q6K and Q80 are almost indistinguishable, Q4KM differs in small details. Rendered Chinese text (shop sign and a handwritten price menu) came out correct in all three.
  • —All-GGUF pipeline — Q4KM together with the Q4KM GGUF text encoder and the GGUF prompt rewriter.

Not tested on a Mac. Not tested: a numeric quality comparison against bf16.