BLOG ILLUSTRATION / EXECUTION STORY

Latent generation from controls and history

Controls and retained history condition latent generation. The generated latents supply input for frame decoding and the next state update.

Latent generation from controls and historyControls and retained history condition latent generation. The generated latents supply input for frame decoding and the next state update. New controls action / pose / camera Causal core state + controls Persistent state selected history / KV State update keep / get history / recur Sampler next latent chunk Decode and emit finalized visible frames
Figure 6. Generated latents supply input for frame decoding, and selected generated latents supply input for state updates for subsequent chunks. The state update uses latents, not an assumed decoded-image cache. Controls and retained history condition generation. This diagram shows dependencies. It does not show one architecture for all methods. The author made this diagram to show the relations. Open full-size SVG