paper-with-me

Papers

Instance-dependent Sample Complexity Bounds for Zero-sum Matrix Games

2023-03-19 · Arnab Maiti, Kevin Jamieson, Lillian J. Ratliff

We study the sample complexity of identifying an approximate equilibrium for two-player zero-sum $n\times 2$ matrix games. That is, in a sequence of repeated game plays, how many rounds must the two players play before reaching an approximate equilibrium (e.g., Nash)? We derive instance-dependent bounds that define an ordering over game matrices that captures the intuition that the dynamics of some games converge faster than others. Specifically, we consider a stochastic observation model such that when the two players choose actions $i$ and $j$, respectively, they both observe each other's played actions and a stochastic observation $X_{ij}$ such that $\mathbb E[ X_{ij}] = A_{ij}$. To our knowledge, our work is the first case of instance-dependent lower bounds on the number of rounds the players must play before reaching an approximate equilibrium in the sense that the number of rounds depends on the specific properties of the game matrix $A$ as well as the desired accuracy. We also prove a converse statement: there exist player strategies that achieve this lower bound.

📄 PDF Abstract BibTeX arXiv:2303.10565

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sample Complexity for Quadratic Bandits: Hessian Dependent Bounds and Optimal Algorithms

2023-06-21 · NeurIPS 2023 11 · Qian Yu, Yining Wang, Baihe Huang, Qi Lei 외

In stochastic zeroth-order optimization, a problem of practical relevance is understanding how to fully exploit the local geometry of the underlying objective function. We consider a fundamental setting in which the obje…

valid

From PAC to Instance-Optimal Sample Complexity in the Plackett-Luce Model

2019-03-01 · ICML 2020 1 · Aadirupa Saha, Aditya Gopalan

We consider PAC-learning a good item from $k$-subsetwise feedback information sampled from a Plackett-Luce probability model, with instance-dependent sample complexity performance. In the setting where subsets of a fixed…

PAC learning

Near-Optimal Pure Exploration in Matrix Games: A Generalization of Stochastic Bandits & Dueling Bandits

2023-10-25 · Arnab Maiti, Ross Boczar, Kevin Jamieson, Lillian J. Ratliff

We study the sample complexity of identifying the pure strategy Nash equilibrium (PSNE) in a two-player zero-sum matrix game with noise. Formally, we are given a stochastic model where any learner can sample an entry $(i…

Multi-Armed Bandits

Instance-Dependent Bounds for Zeroth-order Lipschitz Optimization with Error Certificates

2021-02-03 · NeurIPS 2021 12 · François Bachoc, Tommaso R Cesari, Sébastien Gerchinovitz

We study the problem of zeroth-order (black-box) optimization of a Lipschitz function $f$ defined on a compact subset $\mathcal X$ of $\mathbb R^d$, with the additional constraint that algorithms must certify the accurac…

Instance-Dependent Regret Bounds for Learning Two-Player Zero-Sum Games with Bandit Feedback

2025-02-24 · Shinji Ito, Haipeng Luo, Taira Tsuchiya, Yue Wu

No-regret self-play learning dynamics have become one of the premier ways to solve large-scale games in practice. Accelerating their convergence via improving the regret of the players over the naive $O(\sqrt{T})$ bound …