paper-with-me

홈 › Papers

Efficient Lookahead Encoding and Abstracted Width for Learning General Policies in Classical Planning

2026-05-18 · Michael Aichmüller, Simon Ståhlberg, Martin Funkquist, Hector Geffner arxiv

Generalized planning aims to learn policies that generalize across collections of instances within a classical planning domain. Recent Graph Neural Network (GNN) approaches have learned nearly perfect policies for several domains. This work improves on the recently published idea of Iterated Width (IW) policies. Therein, the policy broadens its successor scope through an IW-lookahead search that can "jump" over multiple transitions, simplifying the problem structure. Yet, each transition is evaluated individually, leading to unscalable compute costs and expressivity limitations. Furthermore, although IW(1) is attractive because it scales linearly with the number of atoms, it becomes inefficient once thousands of objects are considered, as in the International Planning Competition (IPC) 2023 benchmark. We address both limitations. First, we introduce a vastly more efficient holistic encoding of the entire search tree. It jointly represents IW(1)-reachable states only by their relational differences to the current state, enabling Relational GNNs (R-GNNs) to score all transitions in a single forward pass. Second, we define Abstracted IW(1) to improve scaling through relational abstraction during novelty checks. Rather than testing fully instantiated atoms, it abstracts each atom by replacing all but one argument with its type. The original atom is novel if any of its abstracted forms is novel. This structural compression shifts novelty search scaling from atoms to objects, while preserving meaningful subgoal structure. We evaluate our contributions on the hyperscaling IPC 2023 benchmark and across diverse domains, including domains requiring features beyond the $C_2$ logic fragment. Our policies achieve new state-of-the-art performance, significantly surpassing prior work, including the classical planner LAMA.

📄 PDF Abstract BibTeX arXiv:2605.18674

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network

Similar Papers 제목 키워드 기반

General Policies, Serializations, and Planning Width

2020-12-15 · Blai Bonet, Hector Geffner

It has been observed that in many of the benchmark planning domains, atomic goals can be reached with a simple polynomial exploration procedure, called IW, that runs in time exponential in the problem width. Such problem…

Width-based Lookaheads with Learnt Base Policies and Heuristics Over the Atari-2600 Benchmark

2021-06-23 · NeurIPS 2021 12 · Stefan O'Toole, Nir Lipovetzky, Miquel Ramirez, Adrian Pearce

We propose new width-based planning and learning algorithms inspired from a careful analysis of the design decisions made by previous width-based planners. The algorithms are applied over the Atari-2600 games and our bes…

Atari Games

General Policies, Subgoal Structure, and Planning Width

2023-11-09 · Blai Bonet, Hector Geffner

It has been observed that many classical planning domains with atomic goals can be solved by means of a simple polynomial exploration procedure, called IW, that runs in time exponential in the problem width, which in the…

Multi-Step Bayesian Optimization for One-Dimensional Feasibility Determination

2016-07-11 · J. Massey Cashore, Lemuel Kumarga, Peter I. Frazier

Bayesian optimization methods allocate limited sampling budgets to maximize expensive-to-evaluate functions. One-step-lookahead policies are often used, but computing optimal multi-step-lookahead policies remains a chall…

Bayesian Optimization

Reinforcement Learning with Multi-Step Lookahead Information Via Adaptive Batching

2026-01-15 · Nadav Merlis arxiv

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent woul…

Reinforcement Learning