paper-with-me

홈 › Papers

On the Equilibrium Elicitation of Markov Games Through Information Design

2021-02-14 · Tao Zhang, Quanyan Zhu

This work considers a novel information design problem and studies how the craft of payoff-relevant environmental signals solely can influence the behaviors of intelligent agents. The agents' strategic interactions are captured by an incomplete-information Markov game, in which each agent first selects one environmental signal from multiple signal sources as additional payoff-relevant information and then takes an action. There is a rational information designer (designer) who possesses one signal source and aims to control the equilibrium behaviors of the agents by designing the information structure of her signals sent to the agents. An obedient principle is established which states that it is without loss of generality to focus on the direct information design when the information design incentivizes each agent to select the signal sent by the designer, such that the design process avoids the predictions of the agents' strategic selection behaviors. We then introduce the design protocol given a goal of the designer referred to as obedient implementability (OIL) and characterize the OIL in a class of obedient perfect Bayesian Markov Nash equilibria (O-PBME). A new framework for information design is proposed based on an approach of maximizing the optimal slack variables. Finally, we formulate the designer's goal selection problem and characterize it in terms of information design by establishing a relationship between the O-PBME and the Bayesian Markov correlated equilibria, in which we build upon the revelation principle in classic information design in economics. The proposed approach can be applied to elicit desired behaviors of multi-agent systems in competing as well as cooperating settings and be extended to heterogeneous stochastic games in the complete- and the incomplete-information environments.

📄 PDF Abstract BibTeX arXiv:2102.07152

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Identification and Estimation of Dynamic Games with Unknown Information Structure

2022-05-07 · Konan Hara, Yuki Ito, Paul Koh

This paper studies the identification and estimation of dynamic games when the underlying information structure is unknown to the researcher. To tractably characterize the set of Markov perfect equilibrium predictions wh…

counterfactual

Incentivizing Truthful Language Models via Peer Elicitation Games

2025-05-19 · Baiting Chen, Tong Zhu, Jiale Han, Lexin Li 외

Large Language Models (LLMs) have demonstrated strong generative capabilities but remain prone to inconsistencies and hallucinations. We introduce Peer Elicitation Games (PEG), a training-free, game-theoretic framework f…

Markov $α$-Potential Games

2023-05-21 · Xin Guo, Xinyu Li, Chinmay Maheshwari, Shankar Sastry 외

We propose a new framework of Markov $\alpha$-potential games to study Markov games. We show that any Markov game with finite-state and finite-action is a Markov $\alpha$-potential game, and establish the existence of an…

Approximate State Abstraction for Markov Games

2024-12-20 · Hiroki Ishibashi, Kenshi Abe, Atsushi Iwasaki

This paper introduces state abstraction for two-player zero-sum Markov games (TZMGs), where the payoffs for the two players are determined by the state representing the environment and their respective actions, with stat…

Soft-Bellman Equilibrium in Affine Markov Games: Forward Solutions and Inverse Learning

2023-03-31 · Shenghui Chen, Yue Yu, David Fridovich-Keil, Ufuk Topcu

Markov games model interactions among multiple players in a stochastic, dynamic environment. Each player in a Markov game maximizes its expected total discounted reward, which depends upon the policies of the other playe…

OpenAI Gym