Lifelong Inverse Reinforcement Learning

2022-07-01 · NeurIPS 2018 12 · Jorge A. Mendez, Shashank Shivkumar, Eric Eaton

Methods for learning from demonstration (LfD) have shown success in acquiring behavior policies by imitating a user. However, even for a single task, LfD may require numerous demonstrations. For versatile agents that must learn many tasks via demonstration, this process would substantially burden the user if each task were learned in isolation. To address this challenge, we introduce the novel problem of lifelong learning from demonstration, which allows the agent to continually build upon knowledge learned from previously demonstrated tasks to accelerate the learning of new tasks, reducing the amount of demonstrations required. As one solution to this problem, we propose the first lifelong learning approach to inverse reinforcement learning, which learns consecutive tasks via demonstration, continually transferring knowledge between tasks to improve performance.

📄 PDF Abstract BibTeX arXiv:2207.00461

Code (1)

lifelong-ml/elirl 공식 구현

Tasks

Lifelong learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Fast Lifelong Adaptive Inverse Reinforcement Learning from Demonstrations

2022-09-24 · Letian Chen, Sravan Jayanthi, Rohan Paleja, Daniel Martin 외

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. However, current LfD frameworks are not capable of…

Continuous Control reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Some Insights into Lifelong Reinforcement Learning Systems

2020-01-27 · Changjian Li

A lifelong reinforcement learning system is a learning system that has the ability to learn through trail-and-error interaction with the environment over its lifetime. In this paper, I give some arguments to show that th…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Neural-Symbolic Architecture for Inverse Graphics Improved by Lifelong Meta-Learning

2019-05-22 · Michael Kissner, Helmut Mayer

We follow the idea of formulating vision as inverse graphics and propose a new type of element for this task, a neural-symbolic capsule. It is capable of de-rendering a scene into semantic information feed-forward, as we…

Few-Shot Learning Meta-Learning

Bayesian Exploration for Lifelong Reinforcement Learning

2021-09-29 · Haotian Fu, Shangqun Yu, Michael Littman, George Konidaris

A central question in reinforcement learning (RL) is how to leverage prior knowledge to accelerate learning in new tasks. We propose a Bayesian exploration method for lifelong reinforcement learning (BLRL) that aims to …

Lifelong learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe Policy Search for Lifelong Reinforcement Learning with Sublinear Regret

2015-05-21 · Haitham Bou Ammar, Rasul Tutunov, Eric Eaton

Lifelong reinforcement learning provides a promising framework for developing versatile agents that can accumulate knowledge over a lifetime of experience and rapidly learn new tasks by building upon prior knowledge. How…