paper-with-me

홈 › Papers

Learning enables adaptation in cooperation for multi-player stochastic games

2020-07-29 · Feng Huang, Ming Cao, Long Wang

Interactions among individuals in natural populations often occur in a dynamically changing environment. Understanding the role of environmental variation in population dynamics has long been a central topic in theoretical ecology and population biology. However, the key question of how individuals, in the middle of challenging social dilemmas (e.g., the "tragedy of the commons"), modulate their behaviors to adapt to the fluctuation of the environment has not yet been addressed satisfactorily. Utilizing evolutionary game theory and stochastic games, we develop a game-theoretical framework that incorporates the adaptive mechanism of reinforcement learning to investigate whether cooperative behaviors can evolve in the ever-changing group interaction environment. When the action choices of players are just slightly influenced by past reinforcements, we construct an analytical condition to determine whether cooperation can be favored over defection. Intuitively, this condition reveals why and how the environment can mediate cooperative dilemmas. Under our model architecture, we also compare this learning mechanism with two non-learning decision rules, and we find that learning significantly improves the propensity for cooperation in weak social dilemmas, and, in sharp contrast, hinders cooperation in strong social dilemmas. Our results suggest that in complex social-ecological dilemmas, learning enables the adaptation of individuals to varying environments.

📄 PDF Abstract BibTeX arXiv:2007.14957

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning Strategic Value and Cooperation in Multi-Player Stochastic Games through Side Payments

2023-03-09 · Alan Kuhnle, Jeffrey Richley, Darleen Perez-Lavin

For general-sum, n-player, strategic games with transferable utility, the Harsanyi-Shapley value provides a computable method to both 1) quantify the strategic value of a player; and 2) make cooperation rational through …

FormQ-Learning

Evolution of Cooperation in Public Goods Games with Stochastic Opting-Out

2017-09-12

This paper investigates the evolution of strategic play where players drawn from a finite well-mixed population are offered the opportunity to play in a public goods game. All players accept the offer. However, due to th…

Comparing reactive and memory-one strategies of direct reciprocity

2016-05-23

Direct reciprocity is a mechanism for the evolution of cooperation based on repeated interactions. When individuals meet repeatedly, they can use conditional strategies to enforce cooperative outcomes that would not be f…

Noisy information channel mediated prevention of the tragedy of the commons

2024-08-16 · Samrat Sohel Mondal, Sagar Chakraborty

Synergy between evolutionary dynamics of cooperation and fluctuating state of shared resource being consumed by the cooperators is essential for averting the tragedy of the commons. Not only in humans, but also in the co…

Multiplayer Bandit Learning, from Competition to Cooperation

2019-08-03 · Simina Brânzei, Yuval Peres

The stochastic multi-armed bandit model captures the tradeoff between exploration and exploitation. We study the effects of competition and cooperation on this tradeoff. Suppose there are $k$ arms and two players, Alice …