Learning Reciprocity in Complex Sequential Social Dilemmas

2019-03-19 · Tom Eccles, Edward Hughes, János Kramár, Steven Wheelwright, Joel Z. Leibo

Reciprocity is an important feature of human social interaction and underpins our cooperative nature. What is more, simple forms of reciprocity have proved remarkably resilient in matrix game social dilemmas. Most famously, the tit-for-tat strategy performs very well in tournaments of Prisoner's Dilemma. Unfortunately this strategy is not readily applicable to the real world, in which options to cooperate or defect are temporally and spatially extended. Here, we present a general online reinforcement learning algorithm that displays reciprocal behavior towards its co-players. We show that it can induce pro-social outcomes for the wider group when learning alongside selfish agents, both in a $2$-player Markov game, and in $5$-player intertemporal social dilemmas. We analyse the resulting policies to show that the reciprocating agents are strongly influenced by their co-players' behavior.

📄 PDF Abstract BibTeX arXiv:1903.08082

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Emergent Reciprocity and Team Formation from Randomized Uncertain Social Preferences

2020-11-10 · NeurIPS 2020 12 · Bowen Baker

Multi-agent reinforcement learning (MARL) has shown recent success in increasingly complex fixed-team zero-sum environments. However, the real world is not zero-sum nor does it have fixed teams; humans face numerous soci…

Multi-agent Reinforcement Learning

Cooperation dynamics of generalized reciprocity in state-based social dilemmas

2019-02-28

We introduce a framework for studying social dilemmas in networked societies where individuals follow a simple state-based behavioral mechanism based on generalized reciprocity, which is rooted in the principle "help any…

Multi-agent Reinforcement Learning in Sequential Social Dilemmas

2017-02-10 · Joel Z. Leibo, Vinicius Zambaldi, Marc Lanctot, Janusz Marecki 외

Matrix games like Prisoner's Dilemma have guided research on social dilemmas for decades. However, they necessarily treat the choice to cooperate or defect as an atomic action. In real-world social dilemmas these choices…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Social norms in indirect reciprocity with ternary reputations

2021-09-21 · Yohsuke Murase, Minjae Kim, Seung Ki Baek

Indirect reciprocity is a key mechanism that promotes cooperation in social dilemmas by means of reputation. Although it has been a common practice to represent reputations by binary values, either `good' or `bad', such …

Inequity aversion improves cooperation in intertemporal social dilemmas

2018-03-23 · NeurIPS 2018 12 · Edward Hughes, Joel Z. Leibo, Matthew G. Phillips, Karl Tuyls 외

Groups of humans are often able to find ways to cooperate with one another in complex, temporally extended social dilemmas. Models based on behavioral economics are only able to explain this phenomenon for unrealistic st…

Multi-agent Reinforcement Learning Reinforcement Learning