paper-with-me

Papers

Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4

2023-09-29 · Jiaxian Guo, Bo Yang, Paul Yoo, Bill Yuchen Lin, Yusuke Iwasawa, Yutaka Matsuo

Unlike perfect information games, where all elements are known to every player, imperfect information games emulate the real-world complexities of decision-making under uncertain or incomplete information. GPT-4, the recent breakthrough in large language models (LLMs) trained on massive passive data, is notable for its knowledge retrieval and reasoning abilities. This paper delves into the applicability of GPT-4's learned knowledge for imperfect information games. To achieve this, we introduce \textbf{Suspicion-Agent}, an innovative agent that leverages GPT-4's capabilities for performing in imperfect information games. With proper prompt engineering to achieve different functions, Suspicion-Agent based on GPT-4 demonstrates remarkable adaptability across a range of imperfect information card games. Importantly, GPT-4 displays a strong high-order theory of mind (ToM) capacity, meaning it can understand others and intentionally impact others' behavior. Leveraging this, we design a planning strategy that enables GPT-4 to competently play against different opponents, adapting its gameplay style as needed, while requiring only the game rules and descriptions of observations as input. In the experiments, we qualitatively showcase the capabilities of Suspicion-Agent across three different imperfect information games and then quantitatively evaluate it in Leduc Hold'em. The results show that Suspicion-Agent can potentially outperform traditional algorithms designed for imperfect information games, without any specialized training or examples. In order to encourage and foster deeper insights within the community, we make our game-related data publicly available.

📄 PDF Abstract BibTeX arXiv:2309.17277

Code (1)

cr-gjx/suspicion-agent 공식 구현

Tasks

Card GamesDecision MakingPrompt Engineering

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

ExIt-OOS: Towards Learning from Planning in Imperfect Information Games

2018-08-30 · Andy Kitchen, Michela Benedetti

The current state of the art in playing many important perfect information games, including Chess and Go, combines planning and deep reinforcement learning with self-play. We extend this approach to imperfect information…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Competing in a Complex Hidden Role Game with Information Set Monte Carlo Tree Search

2020-05-14 · Jack Reinhardt

Advances in intelligent game playing agents have led to successes in perfect information games like Go and imperfect information games like Poker. The Information Set Monte Carlo Tree Search (ISMCTS) family of algorithms…

Look-ahead Reasoning with a Learned Model in Imperfect Information Games

2025-10-06 · Ondřej Kubíček, Viliam Lisý arxiv

Test-time reasoning significantly enhances pre-trained AI agents' performance. However, it requires an explicit environment model, often unavailable or overly complex in real-world scenarios. While MuZero enables effecti…

Learning to Play Imperfect-Information Games by Imitating an Oracle Planner

2020-12-22 · Rinu Boney, Alexander Ilin, Juho Kannala, Jarno Seppänen

We consider learning to play multiplayer imperfect-information games with simultaneous moves and large state-action spaces. Previous attempts to tackle such challenging games have largely focused on model-free learning m…

Thompson Sampling

The Ludii Game Description Language is Universal

2022-05-01 · Dennis J. N. J. Soemers, Éric Piette, Matthew Stephenson, Cameron Browne

There are several different game description languages (GDLs), each intended to allow wide ranges of arbitrary games (i.e., general games) to be described in a single higher-level language than general-purpose programmin…