CoolFace
Modelpublic

thedeoxen/refcontrol-flux-kontext-reference-lineart-lora

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
12likes160downloads
Model Card

Model description

license: apache-2.0 base_model:

  • —black-forest-labs/FLUX.1-Kontext-dev pipeline_tag: image-to-image ---

RefControl Flux Kontext – Reference Lineart LoRA

📝 Short description

A LoRA for Flux Kontext Dev that fuses a reference image (left) with a lineart map (right). It preserves identity and style from the reference while following the lines and contours from the control.

Trigger word: `refcontrollineart`

Demo video

ReferenceResult
ref1res1
ref2res2
ref3res3

📖 Extended description

This LoRA was primarily trained on human characters and objects, but it works well with stylized art too. The main goal is to preserve identity — facial features, clothing, or style — from the reference image, while adapting them to the structure given by the lineart map.


⚙️ How to use

  1. 1.Concatenate two images side by side:
  2. 2.Left: reference image (person, character, or object).
  3. 3.Right: lineart map (black & white contour drawing).
  4. 4.Add the trigger word `refcontrollineart` in your prompt.
  5. 5.Adjust LoRA weight (recommended 0.7–1.0).

✅ Example prompt

refcontrolcanny, change ineart to photo with reference from left


🎯 What it does

  • —Preserves identity and style of the reference.
  • —Uses lineart to control outlines, proportions, and composition.
  • —Works for both realistic and stylized generations.

⚡ Tips

  • —Best results when the lineart map is clear and clean (minimal shading). ---

📌 Use cases

  • —Converting sketches to full artworks while keeping reference identity.
  • —Character redraws in different art styles.
  • —Consistent character design across multiple illustrations.
  • —Turning lineart drafts into photorealistic or stylized renders.

Download model

Download them in the Files & versions tab.