servantofares/MiMo-V2.6-Pro-RL

<br/><br/>

<div align="center"> <picture> <source srcset="https://github.com/XiaomiMiMo/MiMo/raw/main/figures/XiaomiMiModarkmode.png?raw=true" media="(prefers-color-scheme: dark)"> <img src="https://github.com/XiaomiMiMo/MiMo/raw/main/figures/Xiaomi_MiMo.png?raw=true" width="60%" alt="Xiaomi-MiMo" /> </picture> </div>

<br/>

<div align="center" style="line-height: 1;"> | <a href="https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL" target="blank">🤗 HuggingFace</a> &nbsp;| <a href="https://mimo.xiaomi.com/mimo-v2-6" target="blank">📰 Blog </a> &nbsp;| <a href="https://platform.xiaomimimo.com" target="blank">🎨 Xiaomi MiMo API Platform </a> &nbsp;| <a href="https://aistudio.xiaomimimo.com" target="blank">🗨️ Xiaomi MiMo Studio </a> &nbsp;| <a href="https://mimo.xiaomimimo.com/desktop/" target="_blank">💻 Xiaomi MiMo Desktop </a> &nbsp;| </div>

<br/>

<div align="center" style="line-height: 1.2;"> <strong>Community</strong><br/> <a href="https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/blob/main/assets/wechat.jpg" target="blank">WeChat Group</a> &nbsp;|&nbsp; <a href="https://discord.gg/kKC2kNnQEX" target="blank">Discord</a> &nbsp;|&nbsp; <a href="https://t.me/+3T-I0pekOVIyNDBl" target="blank">Telegram</a> &nbsp;|&nbsp; <a href="https://www.reddit.com/r/XiaomiMiMoOfficial/" target="_blank">Reddit</a> </div>

<br/>

MiMo-V2.6-Pro-RL

Scaling Reinforcement Learning Toward Self-Improvement

<p align="center"> <a href="https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL/blob/main/MiMoV26technicalreport.pdf"><b>Technical Report</b></a> </p>

1. Introduction

MiMo-V2.6-Pro-RL is the flagship checkpoint of the MiMo-V2.6 series. The series is built to scale reinforcement learning toward self-improvement — scaling RL compute, environment diversity, and grader compute together, so the model keeps expanding its capability frontier through exploration and feedback. Key features include:

• —Native Omnimodal + Long Horizon: Text, image, video, and audio in one model; 1M tokens for long repositories, tool traces, and multi-session agent runs.
• —You Only RL Once: One mixed RL run across coding, general agents, visual, and cybersecurity — not separate per-domain runs. Tasks and multiple harnesses are mixed in the same batch so capabilities reinforce each other and strategies transfer to harnesses never seen in training.
• —Scaling RL Compute: Fully asynchronous Group Relative Policy Optimization (GRPO) on very large batches — 1,568 prompts × 16 rollouts per step, billions of tokens per update.
• —Groupwise Agentic Grading (Self-Improvement Loop): Binary pass/fail cannot rank passing solutions, so the reward signal itself is scaled. An agentic grader compares rollouts within each group: Groupwise Reward Synthesis (GRS) builds task-specific rubrics offline from contrasting rollouts and fuses rubric quality with test outcomes; Groupwise Advantage Redistribution (GAR) ranks passing trajectories online and moves advantage toward higher-quality solutions. Judged against the policy’s own samples, this closes a self-improvement loop and steers toward shorter paths and fewer tokens per task.
• —Aligned RL: Cold start from self-correction — the model reflects on and rewrites its own misaligned turns into grounded next steps. Throughout RL, environment hardening, adversarial screening, and verifier cross-checks keep the loop honest against reward hacking.
• —Multi-Prefix Multi-Teacher On-Policy Distillation (MOPD2): After mixed RL, MOPD2 combines autonomous student rollouts with prefix-conditioned single-turn rollouts (Teacher-Prefix and SFT-Prefix), reusing histories from teacher trajectories and SFT demonstrations so decision points train without regenerating preceding turns — extending capabilities to hard-to-verify tasks.

Model Summary

• —Architecture: Sparse MoE (Mixture of Experts), 1.02T total / 42B activated parameters
• —Context Length: 1M tokens
• —Modalities: Text, Image, Video, Audio
• —Vision Encoder: 681M-param MiMo ViT (28 layers: 24 SWA + 4 Full)
• —Audio Encoder: 308M AudioTokenizer + 127M audio patch encoder
• —Multi-Token Prediction (MTP): 5-layer speculative decoder

[image]

Figure 1. MiMo-V2.6 architecture.

2. Downloads

3. Evaluation Results

4. Model Architecture

LLM Backbone

The first Transformer block uses global attention with a dense FFN. Remaining blocks interleave local SWA and GA; both use sparse MoE FFNs without shared experts.

Vision Encoder (MiMo ViT)

Audio Encoders

AudioTokenizer encoder: 24 layers (12 SWA / 12 GA), hidden 1024, 20 RVQ codebooks, 308M parameters. Audio patch encoder: 6 layers, 127M parameters; four frames per patch (25 Hz → 6.25 Hz).

Speculative Decoder

5-layer SWA MTP drafter (DFlash-style). Predicts 7 subsequent tokens per forward pass for parallel verification.

5. Deployment

For best performance, follow the SGLang MiMo cookbook. Docker image: lmsysorg/sglang:latest.

SGLang

sglang serve \
  --trust-remote-code \
  --model-path XiaomiMiMo/MiMo-V2.6-Pro-RL \
  --tp 16 \
  --dp 2 \
  --enable-dp-attention \
  --mm-enable-dp-encoder \
  --ep 16 \
  --moe-a2a-backend deepep \
  --moe-dense-tp-size 1 \
  --mem-fraction-static 0.7 \
  --max-running-requests 128 \
  --chunked-prefill-size 32768 \
  --page-size 64 \
  --swa-full-tokens-ratio 0.3 \
  --speculative-algorithm EAGLE \
  --speculative-num-steps 3 \
  --speculative-eagle-topk 1 \
  --speculative-num-draft-tokens 4 \
  --enable-multi-layer-eagle \
  --reasoning-parser mimo \
  --tool-call-parser mimo \
  --host 0.0.0.0 \
  --port 30000 \
  --nnodes 2 \
  --node-rank <node-rank> \
  --dist-init-addr <node0-ip>:20000

vLLM

Follow the vLLM MiMo-V2.5 recipe. Pre-built image: docker pull vllm/vllm-openai:mimov25-cu129.

vllm serve XiaomiMiMo/MiMo-V2.6-Pro-RL \
  --tensor-parallel-size 8 \
  --trust-remote-code \
  --gpu-memory-utilization 0.95 \
  --max-model-len auto \
  --reasoning-parser mimo \
  --tool-call-parser mimo \
  --enable-auto-tool-choice \
  --generation-config vllm

Recommended sampling: temperature=1.0, top_p=0.95.

Also available in AI Studio, MiMo Code, Xiaomi MiMo Desktop, Xiaomi MiMo Open Platform API, and OpenRouter.

Citation

@misc{mimo2026v26pro,
  title={MiMo-V2.6-Pro-RL},
  author={{Xiaomi MiMo Team}},
  year={2026},
  howpublished={\url{https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL}},
}

Contact

For questions or feedback, reach us at mimo@xiaomi.com or join our community:

• —WeChat Group
• —Discord
• —Telegram
• —Reddit