paper-with-me

Papers

History Filtering in Imperfect Information Games: Algorithms and Complexity

2023-11-24 · NeurIPS 2023 11

Historically applied exclusively to perfect information games, depth-limited search with value functions has been key to recent advances in AI for imperfect information games. Most prominent approaches with strong theoretical guarantees require subgame decomposition - a process in which a subgame is computed from public information and player beliefs. However, subgame decomposition can itself require non-trivial computations, and its tractability depends on the existence of efficient algorithms for either full enumeration or generation of the histories that form the root of the subgame. Despite this, no formal analysis of the tractability of such computations has been established in prior work, and application domains have often consisted of games, such as poker, for which enumeration is trivial on modern hardware. Applying these ideas to more complex domains requires understanding their cost. In this work, we introduce and analyze the computational aspects and tractability of filtering histories for subgame decomposition. We show that constructing a single history from the root of the subgame is generally intractable, and then provide a necessary and sufficient condition for efficient enumeration. We also introduce a novel Markov Chain Monte Carlo-based generation algorithm for trick-taking card games - a domain where enumeration is often prohibitively expensive. Our experiments demonstrate its improved scalability in the trick-taking card game Oh Hell. These contributions clarify when and how depth-limited search via subgame decomposition can be an effective tool for sequential decision-making in imperfect information settings.

📄 PDF Abstract BibTeX arXiv:2311.14651

Code (0)

등록된 구현이 없습니다.

Tasks

Card GamesDecision MakingSequential Decision Making

Similar Papers 제목 키워드 기반

Student of Games: A unified learning algorithm for both perfect and imperfect information games

2021-12-06 · Martin Schmid, Matej Moravcik, Neil Burch, Rudolf Kadlec 외

Games have a long history as benchmarks for progress in artificial intelligence. Approaches using search and learning produced strong performance across many perfect information games, and approaches using game-theoretic…

From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization

2020-02-19 · Julien Perolat, Remi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei 외

In this paper we investigate the Follow the Regularized Leader dynamics in sequential imperfect information games (IIG). We generalize existing results of Poincar\'e recurrence from normal-form games to zero-sum two-play…

Valet: A Standardized Testbed of Traditional Imperfect-Information Card Games

2026-03-03 · Mark Goadrich, Achille Morenville, Éric Piette arxiv

AI algorithms for imperfect-information games are typically compared using performance metrics on individual games, making it difficult to assess robustness across game choices. Card games are a natural domain for imperf…

Computing Nash Equilibria in Multiplayer DAG-Structured Stochastic Games with Persistent Imperfect Information

2020-10-26 · Sam Ganzfried

Many important real-world settings contain multiple players interacting over an unknown duration with probabilistic state transitions, and are naturally modeled as stochastic games. Prior research on algorithms for stoch…

Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4

2023-09-29 · Jiaxian Guo, Bo Yang, Paul Yoo, Bill Yuchen Lin 외

Unlike perfect information games, where all elements are known to every player, imperfect information games emulate the real-world complexities of decision-making under uncertain or incomplete information. GPT-4, the rec…

Card GamesDecision MakingPrompt Engineering