Latent Action as Intention Enables Efficient Future Imagination for World Action Models
Abstract
LAWA improves robot control by using compact latent actions to retain efficient future imagination without generating observations, achieving strong performance with lower latency.
World action models (WAMs) improve robot control by modeling how observations evolve, but generating future observations at test time incurs substantial latency. Fast-WAM removes this process for efficiency; however, our matched implementations show lower generalization for Fast-WAM than for future-aware alternatives, especially with scarce robot demonstrations and in out-of-distribution scenarios. To bridge this gap, we introduce **LAWA**, a WAM architecture that uses compact latent actions as an operational representation of future intentions, enabling efficient test-time future imagination without generating future observations. Specifically, a discrete tokenizer enhanced by action-free pre-training produces manipulation-centric codebook targets. LAWA jointly denoises a continuous latent state anchored to these targets with executable action chunks while omitting the future-video branch at inference. On RoboCasa, LAWA achieves state-of-the-art average success rates of 65.6% and 80.8% in the few-shot and full data settings, improving over the matched Fast-WAM baseline by 9.6 and 4.5 points, respectively. It also preserves the performance level of the matched Joint-WAM variant while requiring 42.9% lower inference latency. LAWA also demonstrates competitive zero-shot robustness on LIBERO-Plus and superior performance on real-world tasks. These results show that future imagination need not be discarded: retaining it with compact latent actions yields an effective trade-off among performance, generalization, and latency. Code and models will be released.
Community
LAWA keeps the benefits of test-time future imagination for world action models while replacing expensive future-observation generation with compact latent intentions, yielding an effective trade-off among performance, generalization, and latency.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Foresight Without Seeing: Latent Futures for World Action Models (2026)
- JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling (2026)
- Learning 4D Geometric Priors for Inference-Efficient World Action Models (2026)
- DreamWAM: Beyond RGB Future Prediction for World Action Models (2026)
- ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts (2026)
- Faster-WAM: Efficient Inference-Time Future Conditioning for Robust World Action Models (2026)
- SLIM-0.5B: Learning Action-Grounded Predictive Latents for Robot Manipulation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2608.24882 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper