CoolFace
Modelpublic

DiffSynth-Studio/Qwen-Image-Distill-Full

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes123downloads
Model Card

Qwen-Image Full Distillation Accelerated Model

[image]

Model Introduction

This model is a distilled and accelerated version of Qwen-Image. The original model requires 40 inference steps and classifier-free guidance (CFG), resulting in a total of 80 forward passes. In contrast, the distilled accelerated model only requires 15 inference steps without CFG, totaling just 15 forward passes—achieving approximately 5x speedup. Of course, the number of inference steps can be further reduced based on requirements, though this may lead to some degradation in generation quality.

The training framework is built upon DiffSynth-Studio. The training data consists of 16,000 images generated by the original model using randomly sampled prompts from DiffusionDB. The training process was conducted on 8 * MI308X GPUs and took approximately one day.

Performance Comparison

Original ModelOriginal ModelAccelerated Model
Inference Steps401515
CFG Scale411
Forward Passes801515
Example 1[image][image][image]
Example 2[image][image][image]
Example 3[image][image][image]

Inference Code

shell
git clone https://github.com/modelscope/DiffSynth-Studio.git  
cd DiffSynth-Studio
pip install -e .
python
from diffsynth.pipelines.qwen_image import QwenImagePipeline, ModelConfig
import torch


pipe = QwenImagePipeline.from_pretrained(
    torch_dtype=torch.bfloat16,
    device="cuda",
    model_configs=[
        ModelConfig(model_id="DiffSynth-Studio/Qwen-Image-Distill-Full", origin_file_pattern="diffusion_pytorch_model*.safetensors"),
        ModelConfig(model_id="Qwen/Qwen-Image", origin_file_pattern="text_encoder/model*.safetensors"),
        ModelConfig(model_id="Qwen/Qwen-Image", origin_file_pattern="vae/diffusion_pytorch_model.safetensors"),
    ],
    tokenizer_config=ModelConfig(model_id="Qwen/Qwen-Image", origin_file_pattern="tokenizer/"),
)
prompt = "精致肖像,水下少女,蓝裙飘逸,发丝轻扬,光影透澈,气泡环绕,面容恬静,细节精致,梦幻唯美。"
image = pipe(prompt, seed=0, num_inference_steps=15, cfg_scale=1)
image.save("image.jpg")