paper-with-me

Papers

Solving Large Extensive-Form Games with Strategy Constraints

2018-09-20 · Trevor Davis, Kevin Waugh, Michael Bowling

Extensive-form games are a common model for multiagent interactions with imperfect information. In two-player zero-sum games, the typical solution concept is a Nash equilibrium over the unconstrained strategy set for each player. In many situations, however, we would like to constrain the set of possible strategies. For example, constraints are a natural way to model limited resources, risk mitigation, safety, consistency with past observations of behavior, or other secondary objectives for an agent. In small games, optimal strategies under linear constraints can be found by solving a linear program; however, state-of-the-art algorithms for solving large games cannot handle general constraints. In this work we introduce a generalized form of Counterfactual Regret Minimization that provably finds optimal strategies under any feasible set of convex constraints. We demonstrate the effectiveness of our algorithm for finding strategies that mitigate risk in security games, and for opponent modeling in poker games when given only partial observations of private information.

📄 PDF Abstract BibTeX arXiv:1809.07893

Code (0)

등록된 구현이 없습니다.

Tasks

counterfactualForm

Similar Papers 제목 키워드 기반

Accelerating Nash Equilibrium Convergence in Monte Carlo Settings Through Counterfactual Value Based Fictitious Play

2023-09-04 · Ju Qi, Falin Hei, Ting Feng, Dengbing Yi 외

Counterfactual Regret Minimization (CFR) and its variants are widely recognized as effective algorithms for solving extensive-form imperfect information games. Recently, many improvements have been focused on enhancing t…

counterfactual

Convergence analysis and acceleration of the smoothing methods for solving extensive-form games

2023-03-20 · Keigo Habara, Ellen Hidemi Fukuda, Nobuo Yamashita

The extensive-form game has been studied considerably in recent years. It can represent games with multiple decision points and incomplete information, and hence it is helpful in formulating games with uncertain inputs, …

Form

Public Information Representation for Adversarial Team Games

2022-01-25 · Luca Carminati, Federico Cacciamani, Marco Ciccone, Nicola Gatti

The peculiarity of adversarial team games resides in the asymmetric information available to the team members during the play, which makes the equilibrium computation problem hard even with zero-sum payoffs. The algorith…

Theoretical and Practical Advances on Smoothing for Extensive-Form Games

2017-02-16 · Christian Kroer, Kevin Waugh, Fatma Kilinc-Karzan, Tuomas Sandholm

Sparse iterative methods, in particular first-order methods, are known to be among the most effective in solving large-scale two-player zero-sum extensive-form games. The convergence rates of these methods depend heavily…

counterfactualForm

No-Regret Strategy Solving in Imperfect-Information Games via Pre-Trained Embedding

2025-11-15 · Yanchang Fu, Shengda Liu, Pei Xu, Kaiqi Huang arxiv

High-quality information set abstraction remains a core challenge in solving large-scale imperfect-information extensive-form games (IIEFGs)--such as no-limit Texas Hold'em--where the finite nature of spatial resources h…