Learn how actions change the world.
We jointly train the action encoder, state encoder, and latent world model to predict future visual representations from current observations and ground-truth robot actions. Future prediction and latent residual supervision teach the model action-dependent dynamics, while counterfactual ranking encourages it to distinguish demonstrated actions from mismatched ones when predicting the observed future.