CoolFace
Modelpublic

CostaliyA/UniCorn

sourceHugging Faceapache-2.0updated 8mo agoView on Hugging Face
2likes34downloads
Model Card

πŸ¦„ UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision

![Paper](https://arxiv.org/pdf/2601.03193v1) ![Hugging Face](https://huggingface.co/CostaliyA/UniCorn) ![Benchmark](https://github.com/shierlouz/Unicycle) ![Project Page](https://costaliya.github.io/UniCorn.github.io//)


🧐 What is UniCorn?

While Unified Multimodal Models (UMMs) excel at comprehension, they often suffer from Conduction Aphasia: the inability to translate internal knowledge into faithful generation.

UniCorn is a simple yet elegant self-improvement framework that eliminates the need for external data or teacher supervision. It partitions a single UMM into three collaborative rolesβ€”Proposer, Solver, and Judgeβ€”to distill latent understanding into explicit generative signals via self-play.

🌟 Key Features

  • β€”Self-Generated Supervision: No external labels or teacher models required.
  • β€”Cognitive Pattern Reconstruction: Bridges the gap between multimodal "understanding" and "synthesis."
  • β€”UniCycle Benchmark: A new cycle-consistency metric (Text ↔ Image ↔ Text) to validate multimodal coherence.
  • β€”SOTA Performance: Leading results on TIIF (73.8), DPG (86.8), and CompBench (88.5).

πŸš€ Quick Start

Inference & Best Practices

To optimize generation quality and avoid common pitfalls like blurriness, follow these hyperparameter guidelines:

  • β€”`cfg_text_scale`: Use 4.0–8.0 for balanced prompt following.
  • β€”`cfg_renorm_type`: Use global for general Text-to-Image tasks.
  • β€”`timestep_shift`: Higher values for better layout; lower values for finer details.
  • β€”`num_timesteps`: Standard setting is 50.

πŸ“Š Results

UniCorn achieves substantial gains over base models (e.g., +6.5 on OneIG, +5.0 on WISE).

ModelTIIF (Short/Long)WISE (Overall)OneIG-EN (Overall)CompBench (Overall)DPG (Score)Geneval (Score)
BAGEL71.0 / 71.850.036.182.284.078.0
UniCorn74.7 / 72.955.042.688.586.882.0
$\Delta$(vs. BAGEL)+3.7 / +1.1+5.0+6.5+6.3+2.8+4.0

πŸ“’ News & Roadmap

  • β€”[x] Jan. 12, 2026: Released model checkpoints.
  • β€”[x] Jan. 07, 2026: Released official Arxiv Report.
  • β€”[ ] To-Do: Release full training and evaluation code.

✍️ Citation

bibtex
@article{han2026unicorn,
  title={UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision},
  author={Han, Ruiyan and Fang, Zhen and Sun, Xinyu and Ma, Yuchen and Wang, Ziheng and Zeng, Yu and Chen, Zehui and Chen, Lin and Huang, Wenxuan and Xu, Wei-Jie and others},
  journal={arXiv preprint arXiv:2601.03193},
  year={2026}
}

πŸ“œ License

This project is licensed under the Apache 2.0 License.