johnsor/Mage-Flow-Edit-Turbo-GGUF

Mage-Flow-Edit-Turbo, Q5_K

A GGUF quantization of Mage-Flow-Edit-Turbo's diffusion transformer for stable-diffusion.cpp: 2.65 GB, down from 8.23 GB at bf16.

Mage-Flow-Edit-Turbo is a 4B native-resolution multimodal diffusion transformer that edits an image from an instruction — hand it a photograph and ask for a scene containing it. It runs in 4 steps, which is what makes it practical on a CPU.

Why Q5_K and not something smaller

Below 5 bits this transformer does not survive stable-diffusion.cpp's uniform quantizer. Converted from the same bf16 source and run with identical settings:

Q5_K is visually indistinguishable from bf16 in my testing, and is the smallest type that is. If you need 4-bit, this is not the model for it — the failure is not graceful degradation but a systematic texture artifact.

Only Q5_K is published here. The others are reproducible in a couple of minutes with the command below if you want them.

Files it needs

This is the transformer only. It also wants:

• —Text encoder — Qwen3VL-4B-Instruct-Q4_K_M.gguf (2.33 GB) and mmproj-Qwen3VL-4B-Instruct-Q8_0.gguf (0.42 GB), both from Qwen/Qwen3-VL-4B-Instruct-GGUF. The mmproj is what lets it look at the reference image; without it a reference is ignored.
• —VAE — mage_flow_vae_bf16.safetensors (0.32 GB) from Comfy-Org/Mage-Flow.

About 5.7 GB all in.

Running it

sd-cli \
  --diffusion-model mage-flow-edit-turbo-Q5_K.gguf \
  --llm Qwen3VL-4B-Instruct-Q4_K_M.gguf \
  --llm_vision mmproj-Qwen3VL-4B-Instruct-Q8_0.gguf \
  --vae mage_flow_vae_bf16.safetensors \
  -r reference.png \
  -p "a photograph of this dog wearing a red knitted scarf, sitting in a snowy park" \
  --steps 4 --cfg-scale 1.0 --sampling-method euler \
  -W 512 -H 512 --diffusion-fa --offload-to-cpu -o out.png

4 steps and --cfg-scale 1 are what the Turbo checkpoint wants; the base checkpoint uses 30 steps. Multiple -r flags pass several reference images.

Example

The reference, and the output of the command above at 512x512 — 99 seconds end to end on a Ryzen 7 4800H, CPU only:

How this was made

sd-cli -M convert \
  --diffusion-model mage_flow_edit_turbo_bf16.safetensors \
  -o mage-flow-edit-turbo-Q5_K.gguf --type q5_K

Source: diffusion_models/mage_flow_edit_turbo_bf16.safetensors from Comfy-Org/Mage-Flow. stable-diffusion.cpp at revision c92d73c408515c94beef32161bb5960764fde7a0. Conversion takes about 75 seconds.

Licence and credit

MIT, following microsoft/Mage. The model is Microsoft's; this repository contributes nothing but a quantization. Note that the microsoft/Mage-Flow and microsoft/Mage-Flow-Edit-Turbo repositories on the Hub are not currently reachable, so Comfy-Org's repackage is the source used here.

Quantized for use in offgrid.