Model-based Reinforcement Learning: A Survey

2020-06-30 · Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker

Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is a important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This paper presents a survey of the integration of both fields, better known as model-based reinforcement learning. Model-based RL has two main steps. First, we systematically cover approaches to dynamics model learning, including challenges like dealing with stochasticity, uncertainty, partial observability, and temporal abstraction. Second, we present a systematic categorization of planning-learning integration, including aspects like: where to start planning, what budgets to allocate to planning and real data collection, how to plan, and how to integrate planning in the learning and acting loop. After these two sections, we also discuss implicit model-based RL as an end-to-end alternative for model learning and planning, and we cover the potential benefits of model-based RL. Along the way, the survey also draws connections to several related RL fields, like hierarchical RL and transfer learning. Altogether, the survey presents a broad conceptual overview of the combination of planning and learning for MDP optimization.

📄 PDF Abstract BibTeX arXiv:2006.16712

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingmodelModel-based Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sequential Decision MakingSurveyTransfer Learning

A Survey of In-Context Reinforcement Learning

2025-02-11 · Amir Moeini, Jiuqi Wang, Jacob Beck, Ethan Blaser 외

Reinforcement learning (RL) agents typically optimize their policies by performing expensive backward passes to update their network parameters. However, some agents can solve new tasks without updating any parameters by…

In-Context Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Reinforcement Learning: A Survey

1996-05-01 · L. P. Kaelbling, M. L. Littman, A. W. Moore

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad…

reinforcement-learning Reinforcement Learning Survey

A Survey of Exploration Methods in Reinforcement Learning

2021-09-01 · Susan Amin, Maziar Gomrokchi, Harsh Satija, Herke van Hoof 외

Exploration is an essential component of reinforcement learning algorithms, where agents need to learn how to predict and control unknown and often stochastic environments. Reinforcement learning agents depend crucially …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Survey

A Brief Survey of Deep Reinforcement Learning

2017-08-19 · Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, Anil Anthony Bharath

Deep reinforcement learning is poised to revolutionise the field of AI and represents a step towards building autonomous systems with a higher level understanding of the visual world. Currently, deep learning is enabling…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

A Survey on Reinforcement Learning Security with Application to Autonomous Driving

2022-12-12 · Ambra Demontis, Maura Pintor, Luca Demetrio, Kathrin Grosse 외

Reinforcement learning allows machines to learn from their own experience. Nowadays, it is used in safety-critical applications, such as autonomous driving, despite being vulnerable to attacks carefully crafted to either…

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)