AI-SOVEREIGN
Home / AI Research / Learning What Actions Change: Action Effect Matching for Dynamics-Faithful World Models
LEAI Research

Learning What Actions Change: Action Effect Matching for Dynamics-Faithful World Models

· John Won, Yonghoon Dong, Jinwoo Shin

World models aim to predict environment dynamics under actions, enabling the prediction of action consequences without executing them in the real world. Yet despite producing increasingly realistic videos, current world models often fail to capture how small action changes affect future observations. This limits their use in tasks such as robotic policy evaluation and model-based planning, where nearly identical actions can lead to qualitatively different outcomes. To address this, we propose AFFECT, an auxiliary training objective for learning the distribution of visual changes induced by action perturbations. Specifically, we inject temporally correlated noise into the actions of a…

Upvotes15
Comments2
Published18 Nov 2026