biali/texture-diffusion

Texture Diffusion

This DreamBooth model is fine-tuned for diffuse textures. It produces flat textures with very little visible lighting/shadows.

Samples

Here are a few example images (generated with 50 steps).

Usage

Use the token pbr in your prompts to invoke the style.

This model was made for use in Dream Textures, a Stable Diffusion add-on for Blender.

You can also use it with 🧨 diffusers:

from diffusers import StableDiffusionPipeline
import torch

model_id = "dream-textures/texture-diffusion"

pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")

prompt = "pbr brick wall"
image = pipe(prompt).images[0]  
    
image.save("bricks.png")

Training Details

• —Base Model: stabilityai/stable-diffusion-2-base
• —Resolution: 512
• —Prior Loss Weight: 1.0
• —Class Prompt: texture
• —Batch Size: 1
• —Learning Rate: 1e-6
• —Precision: fp16
• —Steps: 4000
• —GPU: Tesla T4

Dataset

This model was trained on 278 CC0 textures from PolyHaven.