Efficient Inverse Multiagent Learning

2025-02-20 · Denizalp Goktas, Amy Greenwald, Sadie Zhao, Alec Koppel, Sumitra Ganesh

In this paper, we study inverse game theory (resp. inverse multiagent learning) in which the goal is to find parameters of a game's payoff functions for which the expected (resp. sampled) behavior is an equilibrium. We formulate these problems as generative-adversarial (i.e., min-max) optimization problems, for which we develop polynomial-time algorithms to solve, the former of which relies on an exact first-order oracle, and the latter, a stochastic one. We extend our approach to solve inverse multiagent simulacral learning in polynomial time and number of samples. In these problems, we seek a simulacrum, meaning parameters and an associated equilibrium that replicate the given observations in expectation. We find that our approach outperforms the widely-used ARIMA method in predicting prices in Spanish electricity markets based on time-series data.

📄 PDF Abstract BibTeX arXiv:2502.14160

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series

Multiagent-based Participatory Urban Simulation through Inverse Reinforcement Learning

2017-12-21 · Soma Suzuki

The multiagent-based participatory simulation features prominently in urban planning as the acquired model is considered as the hybrid system of the domain and the local knowledge. However, the key problem of generating …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multiagent Inverse Reinforcement Learning via Theory of Mind Reasoning

2023-02-20 · Haochen Wu, Pedro Sequeira, David V. Pynadath

We approach the problem of understanding how people interact with each other in collaborative settings, especially when individuals know little about their teammates, via Multiagent Inverse Reinforcement Learning (MIRL),…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Weighted Double Deep Multiagent Reinforcement Learning in Stochastic Cooperative Environments

2018-02-23 · Yan Zheng, Jianye Hao, Zongzhang Zhang

Recently, multiagent deep reinforcement learning (DRL) has received increasingly wide attention. Existing multiagent DRL algorithms are inefficient when facing with the non-stationarity due to agents update their policie…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

Deep Multiagent Reinforcement Learning: Challenges and Directions

2021-06-29 · Annie Wong, Thomas Bäck, Anna V. Kononova, Aske Plaat

This paper surveys the field of deep multiagent reinforcement learning. The combination of deep neural networks with reinforcement learning has gained increased traction in recent years and is slowly shifting the focus f…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sociology

Solving Multiagent Planning Problems with Concurrent Conditional Effects

2019-06-19 · Daniel Furelos-Blanco, Anders Jonsson

In this work we present a novel approach to solving concurrent multiagent planning problems in which several agents act in parallel. Our approach relies on a compilation from concurrent multiagent planning to classical p…