CoolFace
Modelpublic

TULLUS/Xiaomi-Robotics-U0-4B-Sequence

sourceHugging Faceapache-2.0updated 6d agoView on Hugging Face
0likes50downloads
Model Card

<p align="center"><strong>TULLUS = I chose to work with this varient because it is ANY-TO-ANY ๐Ÿค–+๐Ÿฆพ</strong></p><hr>

<div align="center"> <h1>Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Models</h1> <p> Xiaomi Robotics </p> <p> <a href="https://arxiv.org/abs/2607.11643"><img src="https://img.shields.io/badge/arXiv-2607.11643-b31b1b.svg" alt="Paper" /></a> <a href="https://robotics.xiaomi.com/xiaomi-robotics-u0.html"><img src="https://img.shields.io/badge/Project-Page-2e7d32.svg" alt="Project Page" /></a> <a href="https://huggingface.co/collections/XiaomiRobotics/xiaomi-robotics-u0"><img src="https://img.shields.io/badge/%F0%9F%A4%97-HuggingFace-ffd21e.svg" alt="Hugging Face" /></a> <a href="https://modelscope.cn/collections/XiaomiRobotics/Xiaomi-Robotics-U0"><img src="https://img.shields.io/badge/ModelScope-Collection-624aff.svg?logo=modelscope&amp;logoColor=white" alt="ModelScope" /></a> <a href="https://github.com/XiaomiRobotics/Xiaomi-Robotics-U0/blob/main/LICENSE"><img src="https://img.shields.io/badge/License-Apache2.0-blue.svg" alt="License" /></a> </p> </div>

<div align="center"> <img src="assets/architecture.png" alt="Xiaomi-Robotics-U0 model architecture with autoregressive generation and FlashAR acceleration." width="100%" /> </div>

**Highlight****Summary**
๐Ÿง World Foundation ModelA 34B autoregressive model for text, images, and embodied observations, initialized from EMU3.5.
๐ŸงฉUnified Token SpaceUses a shared discrete visual tokenizer and a single next-token objective across multimodal sequences.
๐Ÿค–Embodied SynthesisBridges foundation image generation with robot-centric scene, transfer, and video generation.
โšกXiaomi-Robotics-U0-FlashAR AccelerationDecodes visual tokens in anti-diagonal groups and supports vLLM batching for high-resolution inference.
๐Ÿ“ฆOpen Inference RepoProvides inference code, composable configs, Gradio entry points, and AR / FlashAR vLLM patch sets.
๐Ÿ“ˆ1024x1024 T2I SpeedOn one H20, FlashAR vLLM reaches 5.44 s/img, 82.86x faster than AR eager and 3.04x faster than FlashAR eager.

<div align="center"> <img src="assets/illustrate.png" alt="Xiaomi-Robotics-U0 task examples across image generation, embodied scene generation, transfer, and video generation." width="100%" /> </div>

Xiaomi-Robotics-U0 exposes six public task types through one autoregressive framework:

**Task****Input โ†’ Output**
๐ŸŽจT2IText prompt โ†’ image.
๐Ÿ–ผ๏ธX2IReference image plus instruction โ†’ generated or edited image.
๐ŸงญScene GenScene and task description โ†’ multi-view embodied observations.
๐Ÿ”TransferConditioned embodied observation โ†’ target RGB multi-view scene.
๐Ÿฆพinterleave_subtaskInitial observations and task instruction โ†’ interleaved subtask text and observations.
๐ŸŽฌinterleave_videoInitial observation and task context โ†’ embodied video rollout.

News

  • โ€”[September 2026] ๐Ÿ”ฅ Released Xiaomi-Robotics-U0-4B, Xiaomi-Robotics-U0-Sequence, and Xiaomi-Robotics-U0-4B-Sequence weights.
  • โ€”[September 2026] ๐Ÿ’ป Open-sourced the FSDP training code.
  • โ€”[July 2026] ๐ŸŽ‰ Released the Technical Report.
  • โ€”[July 2026] ๐Ÿ”ฅ Released Xiaomi-Robotics-U0 and Xiaomi-Robotics-U0-FlashAR weights.
  • โ€”[July 2026] ๐Ÿ’ป Inference code and scripts are now live!

Table of Contents

  1. 1.Model & Weights
  2. 2.Inference
  3. 3.Training
  4. 4.Citation

Model & Weights

Xiaomi-Robotics-U0, Xiaomi-Robotics-U0-4B, and Xiaomi-Robotics-U0-FlashAR support Scene Gen, Transfer, T2I, and X2I. The Sequence checkpoints support interleave_subtask and interleave_video with the eager backend.

Model nameHugging Face WeightModelScope Weight
Xiaomi-Robotics-U0![Hugging Face](https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0)![ModelScope](https://modelscope.cn/models/XiaomiRobotics/Xiaomi-Robotics-U0)
Xiaomi-Robotics-U0-FlashAR![Hugging Face](https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-FlashAR)![ModelScope](https://modelscope.cn/models/XiaomiRobotics/Xiaomi-Robotics-U0-FlashAR)
Xiaomi-Robotics-U0-4B![Hugging Face](https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-4B)-
Xiaomi-Robotics-U0-Sequence![Hugging Face](https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-Sequence)-
Xiaomi-Robotics-U0-4B-Sequence![Hugging Face](https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-4B-Sequence)-
VisionTokenizer![Hugging Face](https://huggingface.co/BAAI/Emu3.5-VisionTokenizer/)![ModelScope](https://modelscope.cn/models/BAAI/Emu3.5-VisionTokenizer)

Inference

The complete inference implementation, environment setup, configuration reference, command-line examples, and distributed inference instructions are available in `inference/README.md`.

The repository supports both eager execution and vLLM backends for AR and FlashAR inference. A Gradio demo is also provided for interactive T2I, X2I, Scene Gen, and Transfer workflows.

Training

Training code and environment configuration are reserved for `training/README.md` and will be added in a future release.

Citation

If you find this work useful, please cite:

bibtex
@misc{li2026xiaomiroboticsu0,
  title         = {{Xiaomi-Robotics-U0}: Unified Embodied Synthesis with World Foundation Model},
  author        = {Xinghang Li and Jun Guo and Qiwei Li and Long Qian and Hang Lai and Yueze Wang and Hongyu Yan and Jiahang Cao and Xi Chen and Jingen Qu and Jiaxi Song and Nan Sun and Hanye Zhao and Futeng Liu and Wanli Peng and Heyun Wang and Yunhong Wang and Caoyu Xia and Jack Zhao and Diyun Xiang and Hangjun Ye and Heng Qu and Huaping Liu and Jason Li},
  year          = {2026},
  eprint        = {2607.11643},
  archivePrefix = {arXiv},
  url           = {https://arxiv.org/abs/2607.11643}
}