paper-with-me

Papers

On Imperfect Recall in Multi-Agent Influence Diagrams

2023-07-11 · James Fox, Matt MacDermott, Lewis Hammond, Paul Harrenstein, Alessandro Abate, Michael Wooldridge

Multi-agent influence diagrams (MAIDs) are a popular game-theoretic model based on Bayesian networks. In some settings, MAIDs offer significant advantages over extensive-form game representations. Previous work on MAIDs has assumed that agents employ behavioural policies, which set independent conditional probability distributions over actions for each of their decisions. In settings with imperfect recall, however, a Nash equilibrium in behavioural policies may not exist. We overcome this by showing how to solve MAIDs with forgetful and absent-minded agents using mixed policies and two types of correlated equilibrium. We also analyse the computational complexity of key decision problems in MAIDs, and explore tractable cases. Finally, we describe applications of MAIDs to Markov games and team situations, where imperfect recall is often unavoidable.

📄 PDF Abstract BibTeX arXiv:2307.05059

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Understanding Agent Incentives using Causal Influence Diagrams. Part I: Single Action Settings

2019-02-26 · Tom Everitt, Pedro A. Ortega, Elizabeth Barnes, Shane Legg

Agents are systems that optimize an objective function in an environment. Together, the goal and the environment induce secondary objectives, incentives. Modeling the agent-environment interaction using causal influence …

Reinforcement LearningReinforcement Learning (RL)

Equilibrium Refinements for Multi-Agent Influence Diagrams: Theory and Practice

2021-02-09 · Lewis Hammond, James Fox, Tom Everitt, Alessandro Abate 외

Multi-agent influence diagrams (MAIDs) are a popular form of graphical model that, for certain classes of games, have been shown to offer key complexity and explainability advantages over traditional extensive form game …

Form

Imperfect-Recall Games: Equilibrium Concepts and Their Complexity

2024-06-23 · Emanuel Tewolde, Brian Hu Zhang, Caspar Oesterheld, Manolis Zampetakis 외

We investigate optimal decision making under imperfect recall, that is, when an agent forgets information it once held before. An example is the absentminded driver game, as well as team games in which the members have l…

Decision Making

A Complete Criterion for Value of Information in Soluble Influence Diagrams

2022-02-23 · Chris van Merwijk, Ryan Carey, Tom Everitt

Influence diagrams have recently been used to analyse the safety and fairness properties of AI systems. A key building block for this analysis is a graphical criterion for value of information (VoI). This paper establish…

Fairness

Networks of Influence Diagrams: A Formalism for Representing Agents' Beliefs and Decision-Making Processes

2014-01-15 · Yaakov Gal, Avi Pfeffer

This paper presents Networks of Influence Diagrams (NID), a compact, natural and highly expressive language for reasoning about agents beliefs and decision-making processes. NIDs are graphical structures in which agents …

Decision Making