CoolFace
Modelpublic

STAR275/tryon-v1-finetuned

sourceHugging Faceupdated 10mo agoView on Hugging Face
0likes6downloads
Model Card

๐Ÿงฅ TryOn V1 โ€” Fine-Tuned Virtual Try-On Model (LoRA)

This repository contains TryOn V1, a fine-tuned LoRA-based diffusion model trained for Virtual Try-On generation. It takes:

  • โ€”Person Image
  • โ€”Cloth Image

and generates a realistic try-on output.


๐Ÿ”ฅ Key Features

  • โ€”Trained using LoRA fine-tuning
  • โ€”Supports 256ร—256 resolution
  • โ€”Works with large try-on datasets
  • โ€”Handles different clothing types (women wear, men wear, shalwar kameez, etc.)
  • โ€”Fast inference and lightweight LoRA weights

๐Ÿงช Training Method

We used LoRA on a diffusion model with the following configuration:

ParameterValue
Resolution256 ร— 256
Batch Size1 / 2 (A100 optimized)
OptimizerAdamW
Learning Rate1e-4
EpochsVariable (per folder)
LossesVAE + Perceptual + Style

Training was performed incrementally:

  • โ€”Dataset split into multiple folders of 200 images each
  • โ€”Each folder fine-tuned separately
  • โ€”Weights were updated iteratively while preventing GPU crash
  • โ€”Best checkpoints were saved after each run

๐Ÿ“Š Evaluation Metrics

The following metrics were monitored during training:

  • โ€”SSIM
  • โ€”LPIPS
  • โ€”FID
  • โ€”Training Loss Curve
  • โ€”Validation Loss Curve

Graphs for these metrics are included in this repository (if pushed from the training notebook).