Interactive Inverse Reinforcement Learning for Cooperative Games

2021-11-08 · Thomas Kleine Buening, Anne-Marie George, Christos Dimitrakakis

We study the problem of designing autonomous agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic two-agent Markov decision process. We assume control over only the first of the two agents in a Stackelberg formulation of the game, where the second agent is acting so as to maximise expected utility given the first agent's policy. How should the first agent act in order to learn the joint reward function as quickly as possible and so that the joint policy is as close to optimal as possible? We analyse how knowledge about the reward function can be gained in this interactive two-agent scenario. We show that when the learning agent's policies have a significant effect on the transition function, the reward function can be learned efficiently.

📄 PDF Abstract BibTeX arXiv:2111.04698

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Cooperative Inverse Reinforcement Learning

2016-06-09 · NeurIPS 2016 12 · Dylan Hadfield-Menell, Anca Dragan, Pieter Abbeel, Stuart Russell

For an autonomous system to be helpful to humans and to pose no unwarranted risks, it needs to align its values with those of the humans in its environment in such a way that its actions contribute to the maximization of…

Active Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Individual-Level Inverse Reinforcement Learning for Mean Field Games

2022-02-13 · Yang Chen, Libo Zhang, Jiamou Liu, Shuyue Hu

The recent mean field game (MFG) formalism has enabled the application of inverse reinforcement learning (IRL) methods in large-scale multi-agent systems, with the goal of inferring reward signals that can explain demons…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Data-Driven Inverse Reinforcement Learning for Expert-Learner Zero-Sum Games

2023-01-05 · Wenqian Xue, Bosen Lian, Jialu Fan, Tianyou Chai 외

In this paper, we formulate inverse reinforcement learning (IRL) as an expert-learner interaction whereby the optimal performance intent of an expert or target agent is unknown to a learner agent. The learner observes th…

reinforcement-learning Reinforcement Learning (RL)

Auto-Encoding Bayesian Inverse Games

2024-02-14 · Xinjie Liu, Lasse Peters, Javier Alonso-Mora, Ufuk Topcu 외

When multiple agents interact in a common environment, each agent's actions impact others' future decisions, and noncooperative dynamic games naturally capture this coupling. In interactive motion planning, however, agen…

Motion Planning

Recursive Deep Inverse Reinforcement Learning

2025-04-17 · Paul Ghanem, Michael Potter, Owen Howell, Pau Closas 외

Inferring an adversary's goals from exhibited behavior is crucial for counterplanning and non-cooperative multi-agent systems in domains like cybersecurity, military, and strategy games. Deep Inverse Reinforcement Learni…

reinforcement-learning Reinforcement Learning