CoolFace
Modelpublic

network-centrality-labs/jewel-images

sourceHugging Facemitupdated 10mo agoView on Hugging Face
0likes21downloads
Model Card

πŸ’ Museum-Style Jewellery LoRA β€” SDXL

This model is a DreamBooth LoRA fine-tuned version of Stable Diffusion XL, trained to generate museum-quality images of historical jewellery. It learns the visual language of catalogue photography: controlled lighting, high-resolution metal textures, gemstone reflectivity, and authentic archival aesthetics.

The LoRA specialises in objects resembling those found in the Victoria & Albert Museum collection, using a synthetic token β€œTOK” to anchor the learned style.


✨ Model Details

  • β€”Model type: LoRA adapter for SDXL
  • β€”Base model: stabilityai/stable-diffusion-xl-base-1.0
  • β€”VAE: madebyollin/sdxl-vae-fp16-fix
  • β€”Fine-tuning method: DreamBooth LoRA
  • β€”Training resolution: 512Γ—512
  • β€”Domain: Jewellery, catalogue photography
  • β€”Task: Text-to-image generation

🎯 Intended Use

This model excels at:

  • β€”Generating museum-style jewellery photos
  • β€”Creating catalogue-ready rings, necklaces, bracelets
  • β€”Rendering metals, gems, filigree, and antique forms
  • β€”Producing historically coherent designs
  • β€”Visualising jewellery concepts for creative or research use

Not recommended for:

  • β€”Photorealistic human portraits
  • β€”Non-jewellery objects
  • β€”Safety-critical or factual applications
  • β€”High-risk generative design for real gems/metalwork

πŸ“š Training Data

Data was collected programmatically from the Victoria & Albert Museum’s IIIF API, querying for β€œCoronet” and related jewellery classifications.

Each image includes:

  • β€”high-resolution IIIF image
  • β€”systemNumber
  • β€”title / summary
  • β€”curated metadata

Synthetic training captions were produced using GPT-4.1 with detailed instructions focusing on materials, craftsmanship, gemstones, condition, and stylistic cues. This produced a consistent metadata_gpt4.jsonl file.


πŸ”§ Training Configuration

  • β€”Steps: 2000
  • β€”Checkpoints: ~700 steps
  • β€”Batch size: Small with gradient accumulation
  • β€”Optimiser: 8-bit Adam
  • β€”Precision: FP16
  • β€”SNR Ξ³: 5.0
  • β€”Prompt token: "TOK"
  • β€”Framework: Custom Python training pipeline

The LoRA was trained to reproduce metal shine, stone translucency, engraving, patina, and controlled archival lighting.


🧠 Model Behavior

The model produces:

  • β€”Clean, professional product-style photos
  • β€”Sharp metal edges and realistic gemstone reflections
  • β€”Neutral, controlled museum-style lighting
  • β€”Historically plausible jewellery objects
  • β€”Minimal compression artifacts or distortions

Example Characteristics

  • β€”Strong adherence to the β€œTOK” concept token
  • β€”Good compositional control
  • β€”No watermark artifacts (unlike the base SDXL)
  • β€”High material fidelity even at small scales

⚠️ Limitations and Biases

  • β€”May invent non-existent gemstones or designs
  • β€”Limited to jewellery-like structures
  • β€”Not trained on modern fashion photography
  • β€”Depends strongly on correct prompt structure
  • β€”Synthetic captions may introduce subtle biases

πŸ“Š Evaluation

Evaluation is qualitative:

  • β€”Fine-tuned model removes watermark-like patterns
  • β€”Strong improvement in metal realism vs base SDXL
  • β€”Gemstone rendering is materially consistent
  • β€”Museum-style lighting is preserved
  • β€”Produces coherent outputs even with complex prompts

πŸ” License

Released under the MIT License. Users of the LoRA must also comply with the base model’s SDXL license.


πŸ™ Acknowledgements

  • β€”Image data from the Victoria & Albert Museum IIIF API
  • β€”Captions generated with GPT-4.1
  • β€”Base model by Stability AI
  • β€”LoRA training enabled by PEFT + Diffusers

πŸ“£ Citation

If you use this model, please cite:

  • β€”Stability AI (SDXL)
  • β€”Victoria & Albert Museum (image source)
  • β€”GPT-4.1 (caption generation)