Reinforced Imitation Learning from Observations
Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent has access to a sparse reward function and state-only expert observations. We propose a method which gradually balances between the imitation learning cost and the reinforcement learning objective. Built upon an existing imitation learning method, our approach works with state-only observations. We show, through navigation scenarios, that (i) an agent is able to efficiently leverage sparse rewards to outperform standard state-only imitation learning, (ii) it can learn a policy even when learner's actions are different from the expert, and (iii) the performance of the agent is not bounded by that of the expert due to the optimized usage of sparse rewards.
Code (0)
등록된 구현이 없습니다.
Tasks
Imitation LearningReinforcement LearningSimilar Papers 제목 키워드 기반
ReIL: A Framework for Reinforced Intervention-based Imitation Learning
Compared to traditional imitation learning methods such as DAgger and DART, intervention-based imitation offers a more convenient and sample efficient data collection process to users. In this paper, we introduce Reinfor…
Imitation LearningRobot NavigationReinforced Imitation in Heterogeneous Action Space
Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each …
Imitation LearningReinforcement LearningReinforcement Learning (RL)RIDM: Reinforced Inverse Dynamics Modeling for Learning from a Single Observed Demonstration
Augmenting reinforcement learning with imitation learning is often hailed as a method by which to improve upon learning from scratch. However, most existing methods for integrating these two techniques are subject to sev…
Imitation Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)An Imitation from Observation Approach to Transfer Learning with Dynamics Mismatch
We examine the problem of transferring a policy learned in a source environment to a target environment with different dynamics, particularly in the case where it is critical to reduce the amount of interaction with the …
Transfer LearningReinforced Linear Genetic Programming
Linear Genetic Programming (LGP) is a powerful technique that allows for a variety of problems to be solved using a linear representation of programs. However, there still exists some limitations to the technique, such a…