CoolFace
Modelpublic

abcd2019/Anime-face-generation

sourceHugging Facemitupdated 9mo agoView on Hugging Face
0likes48downloads
Model Card

Anime Face Diffusion Model ๐ŸŽจ

A fine-tuned diffusion model for generating high-quality anime faces using DDPM. This model is based on Google's pre-trained ddpm-celebahq-256 model and fine-tuned on 7,000+ anime face images.

Model Details

  • โ€”Model Type: Denoising Diffusion Probabilistic Model (DDPM)
  • โ€”Base Model: google/ddpm-celebahq-256
  • โ€”Task: Unconditional Image Generation (256ร—256 anime faces)
  • โ€”Training Data: 7,000+ high-quality anime face images
  • โ€”Framework: ๐Ÿงจ Diffusers
  • โ€”License: MIT

Training Parameters

  • โ€”Learning Rate: 2e-5
  • โ€”Epochs: 15
  • โ€”Batch Size: 4
  • โ€”Gradient Accumulation Steps: 2
  • โ€”Training Steps: ~26,250 (1750 steps/epoch ร— 15 epochs)
  • โ€”Optimizer: AdamW
  • โ€”Loss: MSE (Mean Squared Error)

Usage

Basic Usage

python
from diffusers import DDPMPipeline
import torch

# Load the model
pipeline = DDPMPipeline.from_pretrained("abcd2019/Anime-face-generation")
device = "cuda" if torch.cuda.is_available() else "cpu"
pipeline = pipeline.to(device)

# Generate a single image
image = pipeline(num_inference_steps=100).images[0]
image.save("anime_face.png")

Generate Multiple Images

python
from diffusers import DDPMPipeline

pipeline = DDPMPipeline.from_pretrained("abcd2019/Anime-face-generation")
pipeline = pipeline.to("cuda")

# Generate 5 anime faces
images = pipeline(batch_size=5, num_inference_steps=100).images

for i, image in enumerate(images):
    image.save(f"anime_face_{i}.png")

Adjust Inference Steps for Quality vs Speed

python
# Fast generation (fewer steps, less quality)
fast_image = pipeline(num_inference_steps=50).images[0]

# High quality (more steps, slower)
quality_image = pipeline(num_inference_steps=150).images[0]

# Recommended: 100 steps for good balance
balanced_image = pipeline(num_inference_steps=100).images[0]

Use Different Scheduler

python
from diffusers import DDPMPipeline, DDIMScheduler

pipeline = DDPMPipeline.from_pretrained("abcd2019/Anime-face-generation")

# Switch to DDIM for faster sampling
scheduler = DDIMScheduler.from_config(pipeline.scheduler.config)
scheduler.set_timesteps(num_inference_steps=50)
pipeline.scheduler = scheduler

fast_image = pipeline().images[0]  # Generates in ~50 steps instead of 1000

Model Performance

  • โ€”Training Loss: ~0.0077 (final epoch)
  • โ€”Image Resolution: 256ร—256 pixels
  • โ€”Inference Speed: ~30-60 seconds per image (depending on steps)
  • โ€”Recommended Inference Steps: 100 (for best quality)
  • โ€”Generated Face Styles: Wide diversity of anime faces with various:
  • โ€”Hair colors and styles
  • โ€”Eye colors and expressions
  • โ€”Face shapes and features
  • โ€”Skin tones

Limitations & Bias

  • โ€”Resolution: Limited to 256ร—256 pixels (inherent to model architecture)
  • โ€”Style: Specifically trained on anime faces, may not generate realistic/photorealistic faces
  • โ€”Diversity: Generated faces are limited to patterns in training data
  • โ€”Quality Variation: Face shape clarity depends on inference steps (higher = better)

Training Details

Data Preparation

  • โ€”Dataset: Anime Face Dataset (Kaggle)
  • โ€”Total Images: 7,000
  • โ€”Selection Method: Top quality images by file size
  • โ€”Preprocessing:
  • โ€”Resized to 256ร—256
  • โ€”Random horizontal flip (50% probability)
  • โ€”Normalized to [-1, 1]

Fine-tuning Approach

  • โ€”Started from pre-trained ddpm-celebahq-256
  • โ€”Fine-tuned with low learning rate to preserve general face generation knowledge
  • โ€”Adapted to anime-specific features (large eyes, stylized features, etc.)

Training Dynamics

  • โ€”Epoch 0-3: Model adapts from photorealistic to anime style
  • โ€”Epoch 4-8: Loss continues to decrease, anime features solidify
  • โ€”Epoch 9+: Marginal improvements, risk of overfitting

Ethical Considerations

This model generates synthetic anime faces and should not be used to:

  • โ€”Create misleading/deceptive content
  • โ€”Generate non-consensual images of real people
  • โ€”Violate any local laws or regulations

Recommended Citation

If you use this model in your research or project, please credit:

  • โ€”The original DDPM paper
  • โ€”Google's pre-trained ddpm-celebahq-256 model
  • โ€”This fine-tuned adaptation

Future Improvements

Potential enhancements for future versions:

  • โ€”Higher resolution (512ร—512 or more)
  • โ€”Conditional generation (text-to-image for anime faces)
  • โ€”Better diversity through larger training datasets
  • โ€”Improved training with advanced schedulers or techniques

Resources


Created: 2025-12-28

Model Card Contact: [Your Name/Username]