about
Looped World Models (arxiv.org)
1 point by ilreb 109 days ago | hide | past | pdf | discuss on HN

In plain words: A world model that reuses one transformer block in a loop, repeatedly polishing its internal picture of the environment and spending more passes on harder steps. It reaches up to 100 times the parameter efficiency of the usual approach, which stacks many separate blocks.

Abstract

Current world models face a fundamental tension: faithful long-horizon simulation demands deep computation, but deeper models are expensive to deploy and prone to compounding errors. We resolve this by introducing Looped World Models (LoopWM), which are the first looped architectures for world modelling. Our method iteratively refines latent environment states through a parameter-shared transformer block. This yield up to 100x parameter efficiency over conventional approaches with adaptive computation that automatically scales depth to match the complexity of each prediction step. Orthogonal to scaling model size and training data, LoopWM establishes iterative latent depth as a new scaling axis for world simulation, which might significantly push the community forward.

Hongyuan Adam Lu, Z. L. Victor Wei, Qun Zhang, Jinrui Zeng, Bowen Cao, Lingwei Meng, Mocheng Li, Zezhong Wang, Haonan Yin, Naifu Xue, Minyu Chen, Cenyuan Zhang, et al.
arXiv:2606.18208 · cs.LG, cs.AI, cs.CL, cs.CV · submitted Jun 16, 2026
abstract · pdf · html · Technical Report

add comment on HN