홈 › Papers

Planning with Abstract Learned Models While Learning Transferable Subtasks

2019-12-16 · John Winder, Stephanie Milani, Matthew Landen, Erebus Oh, Shane Parr, Shawn Squire, Marie desJardins, Cynthia Matuszek

We introduce an algorithm for model-based hierarchical reinforcement learning to acquire self-contained transition and reward models suitable for probabilistic planning at multiple levels of abstraction. We call this framework Planning with Abstract Learned Models (PALM). By representing subtasks symbolically using a new formal structure, the lifted abstract Markov decision process (L-AMDP), PALM learns models that are independent and modular. Through our experiments, we show how PALM integrates planning and execution, facilitating a rapid and efficient learning of abstract, hierarchical models. We also demonstrate the increased potential for learned models to be transferred to new and related tasks.

📄 PDF Abstract BibTeX arXiv:1912.07544

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reward-Respecting Subtasks for Model-Based Reinforcement Learning

2022-02-07 · Richard S. Sutton, Marlos C. Machado, G. Zacharias Holland, David Szepesvari 외

To achieve the ambitious goals of artificial intelligence, reinforcement learning must include planning with a model of the world that is abstract in state and time. Deep learning has made progress with state abstraction…

Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning

2023-09-30 · Mingde Zhao, Safa Alver, Harm van Seijen, Romain Laroche 외

Inspired by human conscious planning, we propose Skipper, a model-based reinforcement learning framework utilizing spatio-temporal abstractions to generalize better in novel situations. It automatically decomposes the gi…

Decision Making Model-based Reinforcement Learning reinforcement-learning Zero-shot Generalization

Accurately and Efficiently Interpreting Human-Robot Instructions of Varying Granularities

2017-04-21 · Dilip Arumugam, Siddharth Karamcheti, Nakul Gopalan, Lawson L. S. Wong 외

Humans can ground natural language commands to tasks at both abstract and fine-grained levels of specificity. For instance, a human forklift operator can be instructed to perform a high-level action, like "grab a pallet"…

Specificity

Learning Abstract and Transferable Representations for Planning

2022-05-04 · Steven James, Benjamin Rosman, George Konidaris

We are concerned with the question of how an agent can acquire its own representations from sensory data. We restrict our focus to learning representations for long-term planning, a class of problems that state-of-the-ar…

Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play

2026-04-20 · Xiachong Feng, Deyi Yin, Xiaocheng Feng, Yi Jiang 외 arxiv

Games offer a compelling paradigm for developing general reasoning capabilities in language models, as they naturally demand strategic planning, probabilistic inference, and adaptive decision-making. However, existing se…

Mathematical Reasoning Code Generation