ghoskno/Fake-QRcode

1---2library_name: diffusers3license: apache-2.04language:5- en6pipeline_tag: image-to-image7---8 9# Fake-QRcode ControlNet10 11These are ControlNet checkpoints trained on runwayml/stable-diffusion-v1-5 to generate recognizable AIGC QRcode image.12 13## Model Details14Details will be added soon...15 16## Use with diffusers17 18See the snippet below for usage with diffusers:19```python20import cv221import numpy as np22import torch23import os, sys24 25from diffusers import StableDiffusionControlNetPipeline, ControlNetModel, AutoencoderKL, EulerAncestralDiscreteScheduler26from PIL import Image27 28controlnet = ControlNetModel.from_pretrained("ghoskno/Fake-Qrcode")29pipe = StableDiffusionControlNetPipeline.from_pretrained(30  "runwayml/stable-diffusion-v1-5", controlnet=controlnet, torch_dtype=torch.float1631)32pipe.scheduler = DDIMScheduler.from_config(pipe.scheduler.config)33pipe.enable_model_cpu_offload()34 35generator = torch.manual_seed(412052000)36 37qrcode = cv2.imread('path_to_qrcode.png')38qrcode = cv2.resize(255 - qrcode, (1024, 1024))39 40image = pipe(41  "Blooming chinese chrysanthemum, green leaves growing wantonly, flowers, Complex patterns on the border, Masterpiece Art, Beauty, 8K,  Unreal Engine",42  Image.fromarray(qrcode),43  generator=generator,44  num_inference_steps=37,45  guidance_scale=7,46  controlnet_conditioning_scale=1.8547).images[0]48```49 50## Some examples51 52**input qrcode image**53<img src="./ghoskno.png"  style="zoom: 33%;" />54 55**prompt**: Blooming chinese chrysanthemum, green leaves growing wantonly, flowers, Complex patterns on the border, Masterpiece Art, Beauty, 8K,  Unreal Engine56 57<img src="./1.jpg"  style="zoom: 33%;" />58 59**prompt**: Plum blossoms in the snow, pink stamens, green leaves and branches growing wantonly, flowers, Complex patterns on the border, Masterpiece Art, Beauty, 8K,  Unreal Engine60 61<img src="./2.jpg"  style="zoom: 33%;" />62 63## Limitations and Bias64 65- No strict control by input prompt66- Sometimes generate confusion or generate unrecognizable QRcode images67