CoolFace
Modelpublic

Yang-Tian/StereoWorld

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face
2likes
Model Card

StereoWorld

Official model weights for [StereoWorld: Camera-Guided Stereo Video Generation](https://arxiv.org/abs/2603.17375).

![GitHub](https://github.com/SunYangtian/StereoWorld) ![Paper](https://arxiv.org/abs/2603.17375)

Models

DirectoryModelDescription
StereoWorldModel/Fixed-Baseline StereoGenerates side-by-side stereo video with a configurable but fixed stereo baseline. Use --use_raymap during inference.
StereoWorldFlexModel/Flexible StereoProvides independent left/right camera control with converging, horizontal-offset, depth-offset, and height-offset right-camera modes.
StereoWorldInpaintModel/Fixed-Left View InpaintingGenerates a right-view video from an input left-view video while locking the left-video latents during sampling.

Fixed-Baseline Stereo (StereoWorldModel/)

A binocular teacher model for standard stereo video generation with consistent disparity and a fixed baseline.

Flexible Stereo (StereoWorldFlexModel/)

A multi-view world model with independently controlled left and right camera trajectories and four flexible right-camera modes.

Fixed-Left View Inpainting (StereoWorldInpaintModel/)

Generates a right-view video from an input left-view video with camera-guided fixed-left view inpainting.

Download

Download everything

bash
huggingface-cli download Yang-Tian/StereoWorld --local-dir weights

Download only Fixed-Baseline Stereo

bash
huggingface-cli download Yang-Tian/StereoWorld \
  --include "StereoWorldModel/*" \
  --local-dir weights

Download only Flexible Stereo

bash
huggingface-cli download Yang-Tian/StereoWorld \
  --include "StereoWorldFlexModel/*" \
  --local-dir weights

Download only Fixed-Left View Inpainting

bash
huggingface-cli download Yang-Tian/StereoWorld \
  --include "StereoWorldInpaintModel/*" \
  --local-dir weights

Directory Structure

text
StereoWorld/
├── StereoWorldModel/
│   ├── transformer/
│   ├── vae/
│   ├── tokenizer/
│   ├── text_encoder/
│   └── scheduler/
├── StereoWorldFlexModel/
│   ├── transformer/
│   ├── vae/
│   ├── tokenizer/
│   ├── text_encoder/
│   └── scheduler/
└── StereoWorldInpaintModel/
    ├── transformer/
    ├── vae/
    ├── tokenizer/
    ├── text_encoder/
    └── scheduler/

Usage

Clone the StereoWorld code repository and install its dependencies before running inference:

bash
git clone https://github.com/SunYangtian/StereoWorld.git
cd StereoWorld
pip install -r requirements.txt

Fixed-Baseline Stereo

bash
python3 inference.py \
  --pipeline_dir weights/StereoWorldModel \
  --use_raymap \
  --eval_json ExpData/demo_custom_eval.json

Flexible Stereo

bash
python3 inference_flex.py \
  --pipeline_dir weights/StereoWorldFlexModel \
  --eval_json ExpData/flex_demo_custom_eval.json

Fixed-Left View Inpainting

bash
python3 inference_view_inpainting.py \
  --pipeline_dir weights/StereoWorldInpaintModel \
  --eval_json ExpData/view_inpaint_eval.json

Outputs for the bundled examples are organized under output_view_inpaint/caseN/.

See the GitHub repository for installation details and further inference options.

Citation

bibtex
@article{sun2026stereo,
  title={Stereo World Model: Camera-Guided Stereo Video Generation},
  author={Sun Yang-Tian and Huang Zehuan and Niu Yifan and Ma Lin and Cao Yan-Pei and Ma Yuewen and Qi Xiaojuan},
  journal={arXiv preprint arXiv:2603.17375},
  year={2026}
}