CoolFace
Modelpublic

deepgenteam/DeepGen-1.0-diffusers

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
8likes78downloads
Model Card

πŸ’‘ DeepGen 1.0 (Diffusers Format): A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing

This is the diffusers-compatible version of DeepGen-1.0. The model weights are stored in safetensors format with a self-contained pipeline script (deepgen_pipeline.py) β€” no need to clone the DeepGen repository.

DeepGen 1.0 is a lightweight unified multimodal model with only 5B parameters (3B VLM + 2B DiT). It integrates five core capabilitiesβ€”general image generation, general image editing, reasoning image generation, reasoning image editing, and text renderingβ€”within a single model. Across multiple authoritative benchmarks, DeepGen 1.0 is competitive with or surpassing the state-of-the-art unified multimodal models that are 3Γ— to 16Γ— larger.

πŸ› οΈ Quick Start

Installation

bash
pip install torch diffusers transformers safetensors einops accelerate huggingface_hub
# Flash Attention (recommended)
pip install flash-attn --no-build-isolation

Load Pipeline

python
import torch
from diffusers import DiffusionPipeline

pipe = DiffusionPipeline.from_pretrained(
    "deepgenteam/DeepGen-1.0-diffusers",
    torch_dtype=torch.bfloat16,
    trust_remote_code=True,
)
pipe.to("cuda")

# Optional: enable CPU offload for GPUs with limited memory (< 24GB)
# pipe.enable_model_cpu_offload()

Text-to-Image

python
result = pipe(
    prompt="a racoon holding a shiny red apple over its head",
    height=512, width=512,
    num_inference_steps=50,
    guidance_scale=4.0,
    seed=42,
)
result.images[0].save("output.png")

Image Editing

python
from PIL import Image

source_image = Image.open("guitar.png").convert("RGB")
result = pipe(
    prompt="Take a photo of this guitar placed on a sandy beach with the sunset in the background.",
    image=source_image,
    height=512, width=512,
    num_inference_steps=50,
    guidance_scale=4.0,
    seed=42,
)
result.images[0].save("edited.png")

πŸ“‹ Parameters

ParameterDefaultDescription
promptrequiredText prompt for generation or editing
imageNoneInput image for editing. If None, performs text-to-image generation
height512Output image height
width512Output image width
num_inference_steps50Number of denoising steps
guidance_scale4.0Classifier-free guidance scale
seedNoneRandom seed for reproducibility
negative_prompt""Negative prompt for CFG

πŸ’Ύ Memory Requirements

ModeVRAM
Full GPU~20 GB
CPU Offload (pipe.enable_model_cpu_offload())~14 GB

πŸ“ Directory Structure

DeepGen-1.0-diffusers/
β”œβ”€β”€ transformer/          # SD3 DiT weights (safetensors)
β”œβ”€β”€ vae/                  # AutoencoderKL weights
β”œβ”€β”€ connector/            # SCB Connector weights + config
β”œβ”€β”€ scheduler/            # FlowMatchEulerDiscreteScheduler config
β”œβ”€β”€ tokenizer/            # Qwen2.5-VL tokenizer
β”œβ”€β”€ prompt_template.json  # Prompt formatting template
β”œβ”€β”€ model_index.json      # Model metadata
└── deepgen_pipeline.py   # Self-contained pipeline script
Note: The VLM (Qwen2.5-VL-3B-Instruct) is loaded separately from Qwen/Qwen2.5-VL-3B-Instruct. You can override the VLM path using the vlm_model_path parameter in from_pretrained().

🧠 Method

Our core observation is that a lightweight model, when empowered by synergistic architecture design and data-centric training strategies, can achieve comprehensive capabilities competitive with or even surpassing much larger counterparts. To overcome the limitations of lightweight models in semantic understanding and fine-grained control, we introduce Stacked Channel Bridging (SCB), a deep alignment framework that extracts hierarchical features from multiple VLM layers and fuses them with learnable "think tokens" to provide the generative backbone with structured, reasoning-rich guidance.

ComponentParametersDescription
VLM (Qwen2.5-VL-3B)3BVisual Language Model for understanding prompts and reference images
Connector (SCB)~0.8B6-layer Transformer bridging VLM hidden states to DiT conditioning
DiT (SD3.5M Kontext)2BDiffusion Transformer for image generation
VAE~80MImage encoder/decoder

πŸ“Š Benchmarks

1. General Image Generation

ModelParamsGeneval ↑DPGBench ↑UniGenBench ↑
OmniGen23B + 4B0.8083.5763.09
BAGEL14B0.8285.1061.53
X-Omni7B + 12B0.8387.65πŸ₯‰53.77
Lumina-DiMOO8B0.88πŸ₯‡86.0471.12
Hunyuan-Image-3.080B0.7286.10β€”
Qwen-Image7B + 20B0.87 πŸ₯ˆ88.32 πŸ₯‡78.81 πŸ₯‡
LongCat-Image7B + 6B0.87 πŸ₯ˆ86.80β€”
Z-Image-Turbo4B + 6B0.8485.1571.40
GLM-Image9B + 7Bβ€”84.78β€”
DeepGen 1.0 (SFT)3B + 2B0.86 πŸ₯‰87.0574.18 πŸ₯‰
DeepGen 1.0 (RL)3B + 2B0.87 πŸ₯ˆ87.90 πŸ₯ˆ75.74 πŸ₯ˆ

2. General Image Editing

ModelParamsGEdit-EN ↑ImgEdit ↑
BAGEL14B6.523.20
Qwen-Image-Edit [2509]7B + 20B7.54 πŸ₯ˆ4.35 πŸ₯ˆ
LongCat-Image-Edit7B + 6B7.60 πŸ₯‡4.50 πŸ₯‡
Mammoth28B + 3B + 2B6.604.06
DeepGen 1.0 (SFT)3B + 2B7.124.09
DeepGen 1.0 (RL)3B + 2B7.17 πŸ₯‰4.14 πŸ₯‰

3. Reasoning Image Generation

ModelParamsWISE ↑T2I-CoREBench ↑
OmniGen23B + 4B0.4736.1
BAGEL14B0.70 πŸ₯‰41.1
Hunyuan-Image-3.080B0.5746.0
Qwen-Image7B + 20B0.6246.3 πŸ₯‰
LongCat-Image7B + 6B0.6552.2 πŸ₯‡
Z-Image-Turbo4B + 6B-43.7
DeepGen 1.0 (SFT)3B + 2B0.72 πŸ₯ˆ45.7
DeepGen 1.0 (RL)3B + 2B0.73 πŸ₯‡46.5 πŸ₯ˆ

4. Reasoning Image Editing

ModelParamsRISE ↑UniREditBench ↑
OmniGen23B + 4B-43.4
BAGEL14B11.9 πŸ₯ˆ51.0
Qwen-Image-Edit [2509]7B + 20B8.956.5 πŸ₯‰
DeepGen 1.0 (SFT)3B + 2B13.3 πŸ₯‡77.5 πŸ₯‡
DeepGen 1.0 (RL)3B + 2B10.8 πŸ₯‰75.7 πŸ₯ˆ

⭐ Citation

bibtex
@article{wang2026deepgen,
  title={DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing},
  author={Wang, Dianyi and Li, Ruihang and Han, Feng and Ma, Chaofan and Song, Wei and Wang, Siyuan and Wang, Yibin and Xin, Yi and Liu, Hongjian and Zhang, Zhixiong and others},
  journal={arXiv preprint arXiv:2602.12205},
  year={2026}
}

License

Apache 2.0