paper-with-me

홈 › Papers

Plan-MCTS: Plan Exploration for Action Exploitation in Web Navigation

2026-02-15 · Weiming Zhang, Jihong Wang, Jiamu Zhou, Qingyao Li, Xinbei Ma, Congmin Zheng, Xingyu Lou, Weiwen Liu, Zhuosheng Zhang, Jun Wang, Yong Yu, Weinan Zhang arxiv

Large Language Models (LLMs) have empowered autonomous agents to handle complex web navigation tasks. While recent studies integrate tree search to enhance long-horizon reasoning, applying these algorithms in web navigation faces two critical challenges: sparse valid paths that lead to inefficient exploration, and a noisy context that dilutes accurate state perception. To address this, we introduce Plan-MCTS, a framework that reformulates web navigation by shifting exploration to a semantic Plan Space. By decoupling strategic planning from execution grounding, it transforms sparse action space into a Dense Plan Tree for efficient exploration, and distills noisy contexts into an Abstracted Semantic History for precise state awareness. To ensure efficiency and robustness, Plan-MCTS incorporates a Dual-Gating Reward to strictly validate both physical executability and strategic alignment and Structural Refinement for on-policy repair of failed subplans. Extensive experiments on WebArena demonstrate that Plan-MCTS achieves state-of-the-art performance, surpassing current approaches with higher task effectiveness and search efficiency.

📄 PDF Abstract BibTeX arXiv:2602.14083

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MALinZero: Efficient Low-Dimensional Search for Mastering Complex Multi-Agent Planning

2025-11-08 · Sizhe Tang, Jiayu Chen, Tian Lan arxiv

Monte Carlo Tree Search (MCTS), which leverages Upper Confidence Bound for Trees (UCTs) to balance exploration and exploitation through randomized sampling, is instrumental to solving complex planning problems. However, …

Multi-agent Reinforcement Learning

Scale-Adaptive Balancing of Exploration and Exploitation in Classical Planning

2023-05-16 · Stephen Wissow, Masataro Asai

Balancing exploration and exploitation has been an important problem in both game tree search and automated planning. However, while the problem has been extensively analyzed within the Multi-Armed Bandit (MAB) literatur…

Heuristic Search

Continuous Monte Carlo Graph Search

2022-10-04 · Kalle Kujanpää, Amin Babadi, Yi Zhao, Juho Kannala 외

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient o…

continuous-controlContinuous ControlDecision MakingSequential Decision Making

Bayesian Mixture Modelling and Inference based Thompson Sampling in Monte-Carlo Tree Search

2013-12-01 · NeurIPS 2013 12 · Aijun Bai, Feng Wu, Xiaoping Chen

Monte-Carlo tree search is drawing great interest in the domain of planning under uncertainty, particularly when little or no domain knowledge is available. One of the central problems is the trade-off between exploratio…

Thompson Sampling

ACDZero: MCTS Agent for Mastering Automated Cyber Defense

2026-01-05 · Yu Li, Sizhe Tang, Rongqian Chen, Fei Xu Yu 외 arxiv

Automated cyber defense (ACD) seeks to protect computer networks with minimal or no human intervention, reacting to intrusions by taking corrective actions such as isolating hosts, resetting services, deploying decoys, o…

Reinforcement LearningDecision Making