paper-with-me

Papers

Width-based Lookaheads with Learnt Base Policies and Heuristics Over the Atari-2600 Benchmark

2021-06-23 · NeurIPS 2021 12 · Stefan O'Toole, Nir Lipovetzky, Miquel Ramirez, Adrian Pearce

We propose new width-based planning and learning algorithms inspired from a careful analysis of the design decisions made by previous width-based planners. The algorithms are applied over the Atari-2600 games and our best performing algorithm, Novelty guided Critical Path Learning (N-CPL), outperforms the previously introduced width-based planning and learning algorithms $\pi$-IW(1), $\pi$-IW(1)+ and $\pi$-HIW(n, 1). Furthermore, we present a taxonomy of the Atari-2600 games according to some of their defining characteristics. This analysis of the games provides further insight into the behaviour and performance of the algorithms introduced. Namely, for games with large branching factors, and games with sparse meaningful rewards, N-CPL outperforms $\pi$-IW, $\pi$-IW(1)+ and $\pi$-HIW(n, 1).

📄 PDF Abstract BibTeX arXiv:2106.12151

Code (0)

등록된 구현이 없습니다.

Tasks

Atari Games

Similar Papers 제목 키워드 기반

Constrained Decoding with Speculative Lookaheads

2024-12-09 · Nishanth Nakshatri, Shamik Roy, Rajarshi Das, Suthee Chaidaroon 외

Constrained decoding with lookahead heuristics (CDLH) is a highly effective method for aligning LLM generations to human preferences. However, the extensive lookahead roll-out operations for each generated token makes CD…

Learning heuristics for A*

2022-04-11 · Danilo Numeroso, Davide Bacciu, Petar Veličković

Path finding in graphs is one of the most studied classes of problems in computer science. In this context, search algorithms are often extended with heuristics for a more efficient search of target nodes. In this work w…

Multi-Task Learning

Blockchain Transaction Fee Forecasting: A Comparison of Machine Learning Methods

2023-05-14 · Conall Butler, Martin Crane

Gas is the transaction-fee metering system of the Ethereum network. Users of the network are required to select a gas price for submission with their transaction, creating a risk of overpaying or delayed/unprocessed tran…

Denoising

Omega-Regular Decision Processes

2023-12-14 · Ernst Moritz Hahn, Mateo Perez, Sven Schewe, Fabio Somenzi 외

Regular decision processes (RDPs) are a subclass of non-Markovian decision processes where the transition and reward functions are guarded by some regular property of the past (a lookback). While RDPs enable intuitive an…

Learning Heuristic Search via Imitation

2017-07-10 · Mohak Bhardwaj, Sanjiban Choudhury, Sebastian Scherer

Robotic motion planning problems are typically solved by constructing a search tree of valid maneuvers from a start to a goal configuration. Limited onboard computation and real-time planning constraints impose a limit o…

Heuristic SearchMotion Planningvalid