MochunniaN1/One-to-All-1.3b_2
One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer
This project aims to provide a unified framework for high-fidelity character animation and image pose transfer for references with arbitrary layouts, addressing limitations in existing diffusion models regarding spatially misaligned reference-pose pairs.
🎭 Showcase
Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities.
14B Model
<table align="center"> <tr> <th style="text-align: center;">Reference</th> <th style="text-align: center;">Motion 1</th> <th style="text-align: center;">Motion 2</th> <th style="text-align: center;">Motion 3</th> </tr> <tr> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/newexamples/1.png" width="100"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14bexamples/ref1motion1.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14bexamples/ref1motion2.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14bexamples/ref1motion3.gif" height="250"/></td> </tr> <tr> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/newexamples/2.png" width="100""/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14bexamples/ref2motion1.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14bexamples/ref2motion2.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14bexamples/ref2motion3.gif" height="250"/></td> </tr> </table>
<br>
1.3B Model
The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt).
<table align="center"> <tr> <th style="text-align: center;">Reference</th> <th style="text-align: center;">Motion 1</th> <th style="text-align: center;">Motion 2</th> <th style="text-align: center;">Motion 3</th> </tr> <tr> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/newexamples/3.png" width="100"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3bexamples/ref3motion11.3b.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3bexamples/ref3motion21.3b.gif" height="250"/></td> <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3bexamples/ref3motion31.3b.gif" height="250"/></td> </tr> </table>
Also support longer video & out-of-domain cases <table align="center"> <tr> <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3bexamples/combinedvideo1.gif" height="200"/></td> <td> </td> <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3bexamples/combinedvideo2.gif" height="200"/> </td> </tr> </table>
<br>
Usage
For detailed installation instructions, quick inference examples, and training scripts, please refer to the GitHub repository.
Citation
If you find our work helpful or inspiring, please feel free to cite it.
@article{shi2025one,
title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer},
author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
journal={arXiv preprint arXiv:2511.22940},
year={2025}
}