In plain words: A world model's image encoder is trained with a penalty keeping its internal trajectories locally straight, so straight-line distance there better matches real path distance and planning is easier. This steadied gradient-based goal planning and raised success rates on goal-reaching tasks versus off-the-shelf visual features.
Abstract
Learning good representations is essential for latent planning with world models. While pretrained visual encoders produce strong semantic visual features, they are not tailored to planning and contain information irrelevant -- or even detrimental -- to planning. Inspired by the perceptual straightening hypothesis in human visual processing, we introduce temporal straightening to improve representation learning for latent planning. Using a curvature regularizer that encourages locally straightened latent trajectories, we jointly learn an encoder and a predictor of a Joint-Embedding Predictive Architecture (JEPA) world model. We show that reducing curvature this way makes the Euclidean distance in latent space a better proxy for the geodesic distance and improves the conditioning of the planning objective. We demonstrate empirically that temporal straightening makes gradient-based planning more stable and yields significantly higher success rates across a suite of goal-reaching tasks. Our code is available at https://agenticlearning.ai/temporal-straightening.
Ying Wang, Oumayma Bounou, Gaoyue Zhou, Randall Balestriero, Tim G. J. Rudner, Yann LeCun, Mengye Ren
arXiv:2603.12231 · cs.LG · submitted Mar 12, 2026 · updated Aug 11, 2026
abstract · pdf · html · ICML2026 Camera Ready