Papers
arxiv:2611.00859

Wave Forcing: Towards Speed-of-Light Streaming Video Generation

Published on Oct 31
· Submitted by
Yijie Jin
on Nov 3
#2 Paper of the day
Authors:
,
,
,
,
,
,
,

Abstract

Wave Forcing enables efficient continuous long-video generation with consistent appearance and natural motion through co-designed generation, training, and execution, achieving high throughput and quality.

Real-time long-video generation requires continuous output with consistent appearance and natural motion. Existing chunk-wise autoregressive methods face challenges in both generation efficiency and long-video quality: serialized denoising and history-cache refresh require two forward passes even with one-step denoising, and longer rollouts can degrade quality and cause camera drift. We propose Wave Forcing (WF), which co-designs generation, training, and execution for continuous video output with multi-step denoising. WF uses chunk-wise causal attention to access earlier, cleaner chunks before their denoising is complete, and distributes staggered denoising and cache-refresh stages across full-model replicas to achieve 1F1C: one output chunk per concurrent forward round after pipeline fill. To adapt the model to this continuous generation process, we develop a three-stage training procedure that successively introduces mixed-noise denoising, motion supervision, and causal adaptation using self-generated history. To execute this process efficiently, Wave Runtime (WaveRT) uses Wave Parallelism (WP) for early K/V delivery and communication-computation overlap, together with optimized kernels and pipelined VAE decoding. Experiments on Wan2.1-T2V-1.3B show that 5-step WF maintains overall quality comparable to Rolling Forcing while achieving higher Dynamic Degree on both short and long videos. Our system efficiency experiments show that 4-step WF achieves 147.6 DiT FPS and 134.8 end-to-end FPS on eight H200 GPUs, yielding 7.07x the single-GPU end-to-end throughput. In DiT-only tests with matched SageAttention+W8A8 backends, denoising steps, and GPU counts, WP delivers up to 2.53x the throughput of the faster of the Ulysses and Ring context-parallel baselines across six model scales (1.3B-14B).

Community

Paper author Paper submitter
•
edited about 5 hours ago

We introduce Wave Forcing, a training and execution framework for streaming video generation.

The key idea is wavefront scheduling: later video chunks begin denoising before earlier chunks finish, using their cleaner intermediate states as causal context. WaveRT sends K/V ahead of use and overlaps communication with computation. After pipeline fill, each concurrent forward round produces one video chunk.

Key results:
• Quality: On Wan2.1-T2V-1.3B, 5-step WF maintains overall quality comparable to Rolling Forcing. For 100-second videos, Dynamic Degree improves from 36.63 to 91.45 and Subject Preservation from 92.75 to 97.10.
• System efficiency: Our 4-step benchmark on 8×H200 reaches 147.6 DiT FPS and 134.8 end-to-end FPS, delivering 7.07× single-GPU E2E throughput.
• Parallelism: Up to 2.53× the throughput of the faster Ulysses/Ring baseline in DiT-only tests with matched SageAttention+W8A8 backends, step counts and GPU counts.

Code, training recipes, and 4-step/5-step checkpoints are available. We welcome feedback and discussion!

Project page: https://sjtu-deng-lab.github.io/WaveForcing/
GitHub repo: https://github.com/SJTU-DENG-Lab/WaveForcing

Flash!!!

·
Paper author

Flashing to the Speed-of-Light!

Nice work! The wavefront scheduling idea—letting later chunks start denoising before earlier ones finish—is particularly interesting. Thanks for sharing the code and checkpoints!

I help promote Paperlayer, which pairs papers with AI summaries and notes linked to the original PDF. For anyone who’d like to explore this paper there:

https://paperlayer.ai/abs/2611.00859

·

Thanks for the interest. Please refer to the official arXiv page and GitHub repo for the paper and code.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.00859
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

Datasets citing this paper 1

Spaces citing this paper 2

Collections including this paper 1