paper-with-me

홈 › Papers

Active Inverse Learning in Stackelberg Trajectory Games

2023-08-15 · William Ward, Yue Yu, Jacob Levy, Negar Mehr, David Fridovich-Keil, Ufuk Topcu

Game-theoretic inverse learning is the problem of inferring a player's objectives from their actions. We formulate an inverse learning problem in a Stackelberg game between a leader and a follower, where each player's action is the trajectory of a dynamical system. We propose an active inverse learning method for the leader to infer which hypothesis among a finite set of candidates best describes the follower's objective function. Instead of using passively observed trajectories like existing methods, we actively maximize the differences in the follower's trajectories under different hypotheses by optimizing the leader's control inputs. Compared with uniformly random inputs, the optimized inputs accelerate the convergence of the estimated probability of different hypotheses conditioned on the follower's trajectory. We demonstrate the proposed method in a receding-horizon repeated trajectory game and simulate the results using virtual TurtleBots in Gazebo.

📄 PDF Abstract BibTeX arXiv:2308.08017

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Imitation Learning of Correlated Policies in Stackelberg Games

2025-03-11 · Kunag-Da Wang, Ping-Chun Hsieh, Wen-Chih Peng

Stackelberg games, widely applied in domains like economics and security, involve asymmetric interactions where a leader's strategy drives follower responses. Accurately modeling these dynamics allows domain experts to o…

Imitation Learning

Who Plays First? Optimizing the Order of Play in Stackelberg Games with Many Robots

2024-02-14 · Haimin Hu, Gabriele Dragotto, Zixu Zhang, Kaiqu Liang 외

We consider the multi-agent spatial navigation problem of computing the socially optimal order of play, i.e., the sequence in which the agents commit to their decisions, and its associated equilibrium in an N-player Stac…

Trajectory Planningvalid

Learning in Stackelberg Games with Non-myopic Agents

2022-08-19 · Nika Haghtalab, Thodoris Lykouris, Sloan Nietert, Alexander Wei

We study Stackelberg games where a principal repeatedly interacts with a non-myopic long-lived agent, without knowing the agent's payoff function. Although learning in Stackelberg games is well-understood when the agent …

Convex-Concave Zero-Sum Stochastic Stackelberg Games

2023-09-21 · NeurIPS 2023 11

Zero-sum stochastic Stackelberg games can be used to model a large class of problems, ranging from economics to human robot interaction. In this paper, we develop policy gradient methods to solve these games from noisy g…

Convergence of Learning Dynamics in Stackelberg Games

2019-06-04 · Tanner Fiez, Benjamin Chasnov, Lillian J. Ratliff

This paper investigates the convergence of learning dynamics in Stackelberg games. In the class of games we consider, there is a hierarchical game being played between a leader and a follower with continuous action space…