Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning

2023-02-24 · Ruitu Xu, Yifei Min, Tianhao Wang, Zhaoran Wang, Michael I. Jordan, Zhuoran Yang

We study a heterogeneous agent macroeconomic model with an infinite number of households and firms competing in a labor market. Each household earns income and engages in consumption at each time step while aiming to maximize a concave utility subject to the underlying market conditions. The households aim to find the optimal saving strategy that maximizes their discounted cumulative utility given the market condition, while the firms determine the market conditions through maximizing corporate profit based on the household population behavior. The model captures a wide range of applications in macroeconomic studies, and we propose a data-driven reinforcement learning framework that finds the regularized competitive equilibrium of the model. The proposed algorithm enjoys theoretical guarantees in converging to the equilibrium of the market at a sub-linear rate.

📄 PDF Abstract BibTeX arXiv:2303.04833

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning (RL)

Robust Adversarial Reinforcement Learning via Bounded Rationality Curricula

2023-11-03 · Aryaman Reddi, Maximilian Tölle, Jan Peters, Georgia Chalvatzaki 외

Robustness against adversarial attacks and distribution shifts is a long-standing goal of Reinforcement Learning (RL). To this end, Robust Adversarial Reinforcement Learning (RARL) trains a protagonist against destabiliz…

MuJoCo reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Bounded Rationality Equilibrium Learning in Mean Field Games

2024-11-11 · Yannick Eich, Christian Fabian, Kai Cui, Heinz Koeppl

Mean field games (MFGs) tractably model behavior in large agent populations. The literature on learning MFG equilibria typically focuses on finding Nash equilibria (NE), which assume perfectly rational agents and are hen…

Optimal Investment in a Large Population of Competitive and Heterogeneous Agents

2022-02-23 · Ludovic Tangpi, Xuchen Zhou

This paper studies a stochastic utility maximization game under relative performance concerns in finite agent and infinite agent settings, where a continuum of agents interact through a graphon (see definition below). We…

Dynamical selection of Nash equilibria using Experience Weighted Attraction Learning: emergence of heterogeneous mixed equilibria

2017-06-29 · Robin Nicole, Peter Sollich

We study the distribution of strategies in a large game that models how agents choose among different double auction markets. We classify the possible mean field Nash equilibria, which include potentially segregated stat…

Imputation

Regret Minimization in Population Network Games: Vanishing Heterogeneity and Convergence to Equilibria

2025-07-23 · Die Hu, Shuyue Hu, Chunjiang Mu, Shiqi Fan 외 arxiv

Understanding and predicting the behavior of large-scale multi-agents in games remains a fundamental challenge in multi-agent systems. This paper examines the role of heterogeneity in equilibrium formation by analyzing h…