paper-with-me

홈 › Papers

Understanding Rollout Error in Graph World Models

2026-06-26 · Xinyuan Song, Zekun Cai arxiv

World models are increasingly used for planning, yet most analyses of rollout error assume vector-valued states and scalar error amplification. Many planning environments, however, are naturally graph-structured: agents, tools, skills, routes, and dependencies interact through evolving relations. In this work, we study how prediction errors accumulate in Graph World Models (GWMs). We formulate fixed-edge and dynamic-edge GWM rollouts under a unified state-action transition framework and derive topology-aware error bounds. For fixed-edge rollouts, we show that long-horizon node error separates into a topology factor, governed by the graph spectral radius, and a model factor, governed by layer spectral norms. For dynamic-edge rollouts, we introduce a joint node-edge error operator that captures feedback between feature prediction and structure prediction, revealing when edge errors amplify future message passing. Motivated by these bounds, we propose Error-Aware GWM, a training objective that combines spectral regularization, rollout consistency, and critical-node weighting. Across synthetic graph topologies and heterogeneous agent-graph testbeds, we find that rollout error and planning regret grow with horizon, that dynamic-edge training is necessary when structure evolves, and that Error-Aware GWM improves long-horizon stability without sacrificing one-step accuracy. Our results characterize when graph world models remain reliable under autoregressive planning and when topology makes them fail.

📄 PDF Abstract BibTeX arXiv:2606.27780

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Repair the Amplifier, Not the Symptom: Stable World-Model Correction for Agent Rollouts

2026-07-02 · Xinyuan Song, Zekun Cai arxiv

Long-horizon language agents increasingly maintain executable world models in the form of planning graphs, where tool calls, validators, memory updates, recovery branches, and final answers are connected by typed depende…

Scaling Agents for Computer Use

2025-10-02 · Gonzalo Gonzalez-Pumariega, Vincent Tu, Chih-Lun Lee, Jiachen Yang 외 arxiv

Computer-use agents (CUAs) hold promise for automating everyday digital tasks, but their performance on long-horizon, complex problems remains unreliable. Single-rollout execution is brittle, with small errors compoundin…

Why long model-based rollouts are no reason for bad Q-value estimates

2024-07-16 · Philipp Wissmann, Daniel Hein, Steffen Udluft, Volker Tresp

This paper explores the use of model-based offline reinforcement learning with long model rollouts. While some literature criticizes this approach due to compounding errors, many practitioners have found success in real-…

reinforcement-learningReinforcement Learning

WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL

2026-02-15 · Zhennan Jiang, Shangqing Zhou, Yutong Jiang, Zefang Huang 외 arxiv

Reinforcement learning (RL) promises to unlock capabilities beyond imitation learning for Vision--Language--Action (VLA) models, but its requirement for massive real-world interaction prevents direct deployment on physic…

Reinforcement Learning

Planner-Admissible Graph-PDE Value Extensions for Sparse Goal-Conditioned Planning

2026-05-18 · Shiheng Zhang arxiv

Sparse goal-conditioned planning with few cost-to-go labels can be viewed as a graph-PDE Dirichlet extension problem: extend sparse labels on a goal-dependent boundary to unlabelled graph vertices so that greedy rollouts…