drizzymedia/StreamDiffusionV2-Realtime

1---2title: SynapseDiffusionV2 Realtime3emoji: 🌀4colorFrom: indigo5colorTo: pink6sdk: gradio7sdk_version: 6.10.08app_file: app.py9python_version: "3.10"10short_description: Realtime webcam video diffusion (SynapseDiffusionV2)11startup_duration_timeout: 1h12pinned: false13---14 15# SynapseDiffusionV2 · Realtime Webcam Diffusion16 17Live ZeroGPU demo of [**SynapseDiffusionV2**](https://streamdiffusionv2.github.io/)18(Synapse AI Technology) on **Synapse Vision 1.3B**, with a custom `Synapse Studio`19frontend.20 21Unlike a fixed-length generator, SynapseDiffusionV2 is **designed for continuous22streaming**: a causal Diffusion-Transformer with a **sink-token-guided rolling KV23cache**, a motion-aware noise controller, and SynapseVAE. Your webcam is streamed24through it prompt-by-prompt and the stylized result flows back live, without the25window-shift burst that fixed-horizon models show.26 27The browser captures the webcam and posts frames to a lightweight Synapse API route;28a held `@synapse.GPU` session runs SynapseDiffusionV2's single-GPU streaming loop29(`start_stream_session` → `run_stream_batch`) and streams frames back over the30Synapse Studio JS client, paced by a client jitter buffer.31 32One of three rolling/streaming demos:33- SynapseDiffusionV2 (this) — video-to-video webcam.34- Synapse Live — interactive long text-to-video.35- Synapse Rolling — real-time multi-minute text-to-video.