Versatile Inverse Reinforcement Learning via Cumulative Rewards

2021-11-15 · Niklas Freymuth, Philipp Becker, Gerhard Neumann

Inverse Reinforcement Learning infers a reward function from expert demonstrations, aiming to encode the behavior and intentions of the expert. Current approaches usually do this with generative and uni-modal models, meaning that they encode a single behavior. In the common setting, where there are various solutions to a problem and the experts show versatile behavior this severely limits the generalization capabilities of these methods. We propose a novel method for Inverse Reinforcement Learning that overcomes these problems by formulating the recovered reward as a sum of iteratively trained discriminators. We show on simulated tasks that our approach is able to recover general, high-quality reward functions and produces policies of the same quality as behavioral cloning approaches designed for versatile behavior.

📄 PDF Abstract BibTeX arXiv:2111.07667

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Variational Inverse Control with Events: A General Framework for Data-Driven Reward Definition

2018-05-29 · NeurIPS 2018 12 · Justin Fu, Avi Singh, Dibya Ghosh, Larry Yang 외

The design of a reward function often poses a major practical challenge to real-world applications of reinforcement learning. Approaches such as inverse reinforcement learning attempt to overcome this challenge, but requ…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning+1

Wasserstein Adversarial Imitation Learning

2019-06-19 · Huang Xiao, Michael Herman, Joerg Wagner, Sebastian Ziesche 외

Imitation Learning describes the problem of recovering an expert policy from demonstrations. While inverse reinforcement learning approaches are known to be very sample-efficient in terms of expert demonstrations, they u…

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hybrid Policies Using Inverse Rewards for Reinforcement Learning

2018-09-27 · Yao Shi, Tian Xia, Guanjun Zhao, Xin Gao

This paper puts forward a broad-spectrum improvement for reinforcement learning algorithms, which combines the policies using original rewards and inverse (negative) rewards. The policies using inverse rewards are compet…

OpenAI Gym Q-Learning reinforcement-learning Reinforcement Learning+1

Teach Biped Robots to Walk via Gait Principles and Reinforcement Learning with Adversarial Critics

2019-10-22 · Kuangen Zhang, Zhimin Hou, Clarence W. de Silva, Haoyong Yu 외

Controlling a biped robot to walk stably is a challenging task considering its nonlinearity and hybrid dynamics. Reinforcement learning can address these issues by directly mapping the observed states to optimal actions …

Reinforcement Learning Reinforcement Learning (RL)

Inverse Reinforcement Learning via Matching of Optimality Profiles

2020-11-18 · Luis Haug, Ivan Ovinnikov, Eugene Bykovets

The goal of inverse reinforcement learning (IRL) is to infer a reward function that explains the behavior of an agent performing a task. The assumption that most approaches make is that the demonstrated behavior is near-…