paper-with-me

홈 › Papers

World Action Models: A Survey

2026-06-18 · Qiuhong Shen, Shihua Zhang, Yue Liao, Qi Li, Zhenxiong Tan, Shizun Wang, Shuicheng Yan, Xinchao Wang arxiv

World Action Models (WAMs) are embodied predictive-action models that make a forecast of the future available to action. Recent WAMs repurpose large video generation models, and a parallel line relies on language or vision-language backbones without a video-generation core. This rapid expansion has blurred the boundary among broad world models, video generation models, action-grounded video world models, Vision-Language-Action policies, and WAMs. This survey gives the field a common account. It first clarifies these boundaries, then organizes existing works through two complementary views. The first view asks what each method is required to generate, spanning rendered futures, latent futures, and video-generation-free action reasoning. The second view decomposes each method by predictive substrate, backbone, action coupling, and deployment regime. This anatomy supports a unified discussion of interactability, causality, persistence, physical plausibility, and generalization, followed by data, evaluation, and open challenges. Across these axes, a consistent design pattern emerges: WAMs are not simply video generators with action heads, but predictive-action methods whose design choices trade representational richness against compute, memory, latency, and action-label cost. The field is moving toward methods that generate less of the future while preserving what control requires. The survey homepage is available at https://world-action-models.github.io/.

📄 PDF Abstract BibTeX arXiv:2606.20781

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

Semantics for Robotic Mapping, Perception and Interaction: A Survey

2021-01-02 · Sourav Garg, Niko Sünderhauf, Feras Dayoub, Douglas Morrison 외

For robots to navigate and interact more richly with the world around them, they will likely require a deeper understanding of the world in which they operate. In robotics and related research fields, the study of unders…

Autonomous DrivingNavigateSurvey

Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond

2024-05-06 · Zheng Zhu, XiaoFeng Wang, Wangbo Zhao, Chen Min 외

General world models represent a crucial pathway toward achieving Artificial General Intelligence (AGI), serving as the cornerstone for various applications ranging from virtual environments to decision-making systems. R…

Autonomous DrivingDecision MakingSurveyVideo Generation

Completeness, Recall, and Negation in Open-World Knowledge Bases: A Survey

2023-05-09 · Simon Razniewski, Hiba Arnaout, Shrestha Ghosh, Fabian Suchanek

General-purpose knowledge bases (KBs) are a cornerstone of knowledge-centric AI. Many of them are constructed pragmatically from Web sources, and are thus far from complete. This poses challenges for the consumption as w…

ManagementNegationSurveyWorld Knowledge

Simulating the Real World: A Unified Survey of Multimodal Generative Models

2025-03-06 · Yuqi Hu, Longguang Wang, Xian Liu, Ling-Hao Chen 외

Understanding and replicating the real world is a critical challenge in Artificial General Intelligence (AGI) research. To achieve this, many existing approaches, such as world models, aim to capture the fundamental prin…

3D GenerationSurvey

World Models for Robotic Manipulation: A Survey

2026-05-27 · Fangyuan Wang, Ziyuan Wang, Guorui Pei, Mengshi Zhang 외 arxiv

Robotic manipulation depends on the ability to anticipate how actions reshape objects, contacts, and scene geometry before execution. Learned world models provide this capability by predicting task-relevant future evolut…