prernaaa12/abot-world-interactive

🌍 ABot-World — Interactive World Rollout

Upload a single starting image and steer a live navigable world in real time. Provide a first-frame image (image-to-video seed), describe the scene, and drive the world with WASD (move & turn) / IJKL (look & pan). The model autoregressively rolls out an action-conditioned world and streams decoded frames straight to your browser.

• —Model: `acvlab/ABot-World-0-5B-LF` (built on Wan2.2-TI2V-5B)
• —Code: amap-cvlab/ABot-World
• —Project: ABot-World

Architecture

This Space runs a proper live backend/infrastructure (in the spirit of `Overworld/waypoint-1-5`):

• —`gradio.Server` exposes ZeroGPU-friendly /start_game and /stop_game API endpoints plus a raw WebSocket (/ws) that streams binary JPEG frames and receives live control input — no Gradio UI polling.
• —A custom `index.html` front-end handles image upload (the i2v seed — no video upload needed), live keyboard steering, and a clean HUD.
• —Every endpoint is keyed by a per-client session_id, so concurrent players never share seed images, frame queues, or status messages.
• —ZeroGPU quota is billed to the requesting user: the HF iframe's x-api-token / x-ip-token is forwarded by the Gradio JS client and the incoming request context is propagated into the GPU worker thread, so @spaces.GPU consumes the visitor's own quota rather than the Space owner's.

Inference is causal / block-wise, matching the upstream CausalInferencePipeline.