Interaction-limited Inverse Reinforcement Learning

2020-07-01 · Martin Troussard, Emmanuel Pignat, Parameswaran Kamalaruban, Sylvain Calinon, Volkan Cevher

This paper proposes an inverse reinforcement learning (IRL) framework to accelerate learning when the learner-teacher \textit{interaction} is \textit{limited} during training. Our setting is motivated by the realistic scenarios where a helpful teacher is not available or when the teacher cannot access the learning dynamics of the student. We present two different training strategies: Curriculum Inverse Reinforcement Learning (CIRL) covering the teacher's perspective, and Self-Paced Inverse Reinforcement Learning (SPIRL) focusing on the learner's perspective. Using experiments in simulations and experiments with a real robot learning a task from a human demonstrator, we show that our training strategies can allow a faster training than a random teacher for CIRL and than a batch learner for SPIRL.

📄 PDF Abstract BibTeX arXiv:2007.00425

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Offline Meta-level Model-based Reinforcement Learning Approach for Cold-Start Recommendation

2020-12-04 · Yanan Wang, Yong Ge, Li Li, Rui Chen 외

Reinforcement learning (RL) has shown great promise in optimizing long-term user interest in recommender systems. However, existing RL-based recommendation methods need a large number of interactions for each user to lea…

Model-based Reinforcement Learning Recommendation Systems reinforcement-learning Reinforcement Learning+1

OPIRL: Sample Efficient Off-Policy Inverse Reinforcement Learning via Distribution Matching

2021-09-09 · Hana Hoshino, Kei Ota, Asako Kanezaki, Rio Yokota

Inverse Reinforcement Learning (IRL) is attractive in scenarios where reward engineering can be tedious. However, prior IRL algorithms use on-policy transitions, which require intensive sampling from the current policy f…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Interactive Inverse Reinforcement Learning of Interaction Scenarios via Bi-level Optimization

2026-05-01 · Yue Mao, Shicheng Liu, Siyuan Xu, Minghui Zhu arxiv

Inverse reinforcement learning (IRL) learns a reward function and a corresponding policy that best fit the demonstration data of an expert. However, in the current IRL setting, the learner is isolated from the expert and…

Reinforcement Learning

Graph Inverse Reinforcement Learning from Diverse Videos

2022-07-28 · Sateesh Kumar, Jonathan Zamora, Nicklas Hansen, Rishabh Jangir 외

Research on Inverse Reinforcement Learning (IRL) from third-person videos has shown encouraging results on removing the need for manual reward design for robotic tasks. However, most prior works are still limited by trai…

Diversity reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Generative Adversarial Imitation Learning

2016-06-10 · NeurIPS 2016 12 · Jonathan Ho, Stefano Ermon

Consider learning a policy from example expert behavior, without interaction with the expert or access to reinforcement signal. One approach is to recover the expert's cost function with inverse reinforcement learning, t…

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)