World Models
Models that predict how the world evolves, for simulation and control. 5 notes.
-
Human Motion as a Control Interface for Interactive World Models
This article compares 2D pose, SMPL bodies and tracked head-and-hand motion in interactive video world models. It examines limits from timing, viewpoint and scene persistence.
-
From Human Video to Robot Action: Five Interfaces Across the Embodiment Gap
Compare five methods for learning robot actions from human video. They include latent actions and contact-aware retargeting, with different tasks and evaluations.
-
Streaming Autoregressive Video Generation
This article examines causal video rollouts, teacher-student mismatch, persistent visual memory and online control with a limited sampling budget.
-
Embodied AI World Models
Robot world models connect prediction and action. This guide examines representations, planning, policy learning, aligned data, uncertainty and deployment.
-
On 3D, Video World Models, and the Approaching ImageNet Moment of Perception-Action Learning
This article examines 3D geometry and video world models for perception-action learning. It gives proposed ImageNet-style transfer tests for robotics.
See all tags.