paper-with-me

Papers

Gradient Methods for Solving Stackelberg Games

2019-08-19 · Roi Naveiro, David Ríos Insua

Stackelberg Games are gaining importance in the last years due to the raise of Adversarial Machine Learning (AML). Within this context, a new paradigm must be faced: in classical game theory, intervening agents were humans whose decisions are generally discrete and low dimensional. In AML, decisions are made by algorithms and are usually continuous and high dimensional, e.g. choosing the weights of a neural network. As closed form solutions for Stackelberg games generally do not exist, it is mandatory to have efficient algorithms to search for numerical solutions. We study two different procedures for solving this type of games using gradient methods. We study time and space scalability of both approaches and discuss in which situation it is more appropriate to use each of them. Finally, we illustrate their use in an adversarial prediction problem.

📄 PDF Abstract BibTeX arXiv:1908.06901

Code (1)

roinaveiro/GM_SG 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Convex-Concave Zero-Sum Stochastic Stackelberg Games

2023-09-21 · NeurIPS 2023 11

Zero-sum stochastic Stackelberg games can be used to model a large class of problems, ranging from economics to human robot interaction. In this paper, we develop policy gradient methods to solve these games from noisy g…

Convergence of Learning Dynamics in Stackelberg Games

2019-06-04 · Tanner Fiez, Benjamin Chasnov, Lillian J. Ratliff

This paper investigates the convergence of learning dynamics in Stackelberg games. In the class of games we consider, there is a hierarchical game being played between a leader and a follower with continuous action space…

Implicit Learning Dynamics in Stackelberg Games: Equilibria Characterization, Convergence Analysis, and Empirical Study

2020-01-01 · ICML 2020 1 · Tanner Fiez, Benjamin Chasnov, Lillian Ratliff

Contemporary work on learning in continuous games has commonly overlooked the hierarchical decision-making structure present in machine learning problems formulated as games, instead treating them as simultaneous play ga…

Decision Making

Convex-Concave Min-Max Stackelberg Games

2021-10-05 · NeurIPS 2021 12 · Denizalp Goktas, Amy Greenwald

Min-max optimization problems (i.e., min-max games) have been attracting a great deal of attention because of their applicability to a wide range of machine learning problems. Although significant progress has been made …

Function Approximation for Solving Stackelberg Equilibrium in Large Perfect Information Games

2022-12-29 · Chun Kai Ling, J. Zico Kolter, Fei Fang

Function approximation (FA) has been a critical component in solving large zero-sum games. Yet, little attention has been given towards FA in solving \textit{general-sum} extensive-form games, despite them being widely r…