paper-with-me

홈 › Papers

MCTS-GEB: Monte Carlo Tree Search is a Good E-graph Builder

2023-03-08 · Guoliang He, Zak Singh, Eiko Yoneki

Rewrite systems [6, 10, 12] have been widely employing equality saturation [9], which is an optimisation methodology that uses a saturated e-graph to represent all possible sequences of rewrite simultaneously, and then extracts the optimal one. As such, optimal results can be achieved by avoiding the phase-ordering problem. However, we observe that when the e-graph is not saturated, it cannot represent all possible rewrite opportunities and therefore the phase-ordering problem is re-introduced during the construction phase of the e-graph. To address this problem, we propose MCTS-GEB, a domain-general rewrite system that applies reinforcement learning (RL) to e-graph construction. At its core, MCTS-GEB uses a Monte Carlo Tree Search (MCTS) [3] to efficiently plan for the optimal e-graph construction, and therefore it can effectively eliminate the phase-ordering problem at the construction phase and achieve better performance within a reasonable time. Evaluation in two different domains shows MCTS-GEB can outperform the state-of-the-art rewrite systems by up to 49x, while the optimisation can generally take less than an hour, indicating MCTS-GEB is a promising building block for the future generation of rewrite systems.

📄 PDF Abstract BibTeX arXiv:2303.04651

Code (1)

ucamrl/eqs 공식 구현 pytorch

Tasks

graph constructionReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Monte-Carlo Planning: Theoretically Fast Convergence Meets Practical Efficiency

2013-09-26 · Zohar Feldman, Carmel Domshlak

Popular Monte-Carlo tree search (MCTS) algorithms for online planning, such as epsilon-greedy tree search and UCT, aim at rapidly identifying a reasonably good action, but provide rather poor worst-case guarantees on per…

Monte Carlo Tree Search with Heuristic Evaluations using Implicit Minimax Backups

2014-06-02 · Marc Lanctot, Mark H. M. Winands, Tom Pepels, Nathan R. Sturtevant

Monte Carlo Tree Search (MCTS) has improved the performance of game engines in domains such as Go, Hex, and general game playing. MCTS has been shown to outperform classic alpha-beta search in games where good heuristic …

Combining Monte-Carlo Tree Search with Proof-Number Search

2022-06-08 · Elliot Doe, Mark H. M. Winands, Dennis J. N. J. Soemers, Cameron Browne

Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search m…

Decision Making

Is Monte Carlo Tree Search Just Every-Visit Monte Carlo Control?

2026-08-28 · Xianyi Wu arxiv

Monte Carlo Tree Search (MCTS) and every-visit Monte Carlo (MC) control are usually presented as different methods. MCTS is described in the language of search (selection, expansion, simulation, and backup), whereas MC c…

Reinforcement Learning

Monte Carlo Tree Search Algorithms for Risk-Aware and Multi-Objective Reinforcement Learning

2022-11-23 · Conor F. Hayes, Mathieu Reymond, Diederik M. Roijers, Enda Howley 외

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from a single execution of a policy. In these settings, making decisions based on the average future returns is n…

Multi-Objective Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1