CoolFace
Apppublic

multimodalart/ctrl-x

sourceHugging Faceupdated 2y agoView on Hugging Face
8likes
App README

Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance (NeurIPS 2024)

<a href="https://arxiv.org/abs/2406.07540"><img src="https://img.shields.io/badge/arXiv-Paper-red"></a> <a href="https://genforce.github.io/ctrl-x"><img src="https://img.shields.io/badge/Project-Page-yellow"></a> ![GitHub](https://github.com/genforce/ctrl-x)

Kuan Heng Lin<sup>1</sup>, [Sicheng Mo](https://sichengmo.github.io/)<sup>1</sup>, Ben Klingher<sup>1</sup>, Fangzhou Mu<sup>2</sup>, Bolei Zhou<sup>1</sup> <br> <sup>1</sup>UCLA&emsp;<sup>2</sup>NVIDIA <br> <sup>*</sup>Equal contribution <br>

[image]

Getting started

Environment setup

Our code is built on top of `diffusers v0.28.0`. To set up the environment, please run the following.

conda env create -f environment.yaml
conda activate ctrlx

Gradio demo

We provide a user interface for testing our method. Running the following command starts the demo.

python3 app_ctrlx.py

Have fun playing around! :D

Contact

For any questions, thoughts, discussions, and any other things you want to reach out for, please contact Kuan Heng (Jordan) Lin (kuanhenglin@ucla.edu).

Reference

If you use our code in your research, please cite the following work.

bibtex
@inproceedings{lin2024ctrlx,
    author = {Lin, {Kuan Heng} and Mo, Sicheng and Klingher, Ben and Mu, Fangzhou and Zhou, Bolei},
    booktitle = {Advances in Neural Information Processing Systems},
    title = {Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance},
    year = {2024}
}