A Framework and Method for Online Inverse Reinforcement Learning

2018-05-21 · Saurabh Arora, Prashant Doshi, Bikramjit Banerjee

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the observations are incrementally accrued, yet the demands of the application often prohibit a full rerun of an IRL method---has received relatively less attention. We introduce the first formal framework for online IRL, called incremental IRL (I2RL), and a new method that advances maximum entropy IRL with hidden variables, to this setting. Our formal analysis shows that the new method has a monotonically improving performance with more demonstration data, as well as probabilistically bounded error, both under full and partial observability. Experiments in a simulated robotic application of penetrating a continuous patrol under occlusion shows the relatively improved performance and speed up of the new method and validates the utility of online IRL.

📄 PDF Abstract BibTeX arXiv:1805.07871

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Nonlinear Inverse Reinforcement Learning with Gaussian Processes

2011-12-01 · NeurIPS 2011 12 · Sergey Levine, Zoran Popovic, Vladlen Koltun

We present a probabilistic algorithm for nonlinear inverse reinforcement learning. The goal of inverse reinforcement learning is to learn the reward function in a Markov decision process from expert demonstrations. While…

Gaussian Processes reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Inverse Reinforcement Learning via Deep Gaussian Process

2015-12-26 · Ming Jin, Andreas Damianou, Pieter Abbeel, Costas Spanos

We propose a new approach to inverse reinforcement learning (IRL) based on the deep Gaussian process (deep GP) model, which is capable of learning complicated reward structures with few demonstrations. Our model stacks m…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Online Intention Prediction via Control-Informed Learning

2026-04-10 · Tianyu Zhou, Zihao Liang, Zehui Lu, Shaoshuai Mou arxiv

This paper presents an online intention prediction framework for estimating the goal state of autonomous systems in real time, even when intention is time-varying, and system dynamics or objectives include unknown parame…

Reinforcement Learning

Generative Inverse Deep Reinforcement Learning for Online Recommendation

2020-11-04 · Xiaocong Chen, Lina Yao, Aixin Sun, Xianzhi Wang 외

Deep reinforcement learning enables an agent to capture user's interest through interactions with the environment dynamically. It has attracted great interest in the recommendation research. Deep reinforcement learning u…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Inverse Reinforcement Learning by Estimating Expertise of Demonstrators

2024-02-02 · Mark Beliaev, Ramtin Pedarsani

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as h…

Imitation Learning reinforcement-learning Reinforcement Learning