paper-with-me

홈 › Papers

Consequentialist conditional cooperation in social dilemmas with imperfect information

2017-10-19 · ICLR 2018 1 · Alexander Peysakhovich, Adam Lerer

Social dilemmas, where mutual cooperation can lead to high payoffs but participants face incentives to cheat, are ubiquitous in multi-agent interaction. We wish to construct agents that cooperate with pure cooperators, avoid exploitation by pure defectors, and incentivize cooperation from the rest. However, often the actions taken by a partner are (partially) unobserved or the consequences of individual actions are hard to predict. We show that in a large class of games good strategies can be constructed by conditioning one's behavior solely on outcomes (ie. one's past rewards). We call this consequentialist conditional cooperation. We show how to construct such strategies using deep reinforcement learning techniques and demonstrate, both analytically and experimentally, that they are effective in social dilemmas beyond simple matrix games. We also show the limitations of relying purely on consequences and discuss the need for understanding both the consequences of and the intentions behind an action.

📄 PDF Abstract BibTeX arXiv:1710.06975

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningReinforcement Learning

Similar Papers 제목 키워드 기반

Learning Homophilic Incentives in Sequential Social Dilemmas

2021-09-29 · Heng Dong, Tonghan Wang, Jiayuan Liu, Chi Han 외

Promoting cooperation among self-interested agents is a long-standing and interdisciplinary problem, but receives less attention in multi-agent reinforcement learning (MARL). Game-theoretical studies reveal that altruist…

Multi-agent Reinforcement Learning

CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas

2026-04-16 · Emanuel Tewolde, Xiao Zhang, David Guzman Piedrahita, Vincent Conitzer 외 arxiv

It is increasingly important that LLM agents interact effectively and safely with other goal-pursuing agents, yet, recent works report the opposite trend: LLMs with stronger reasoning capabilities behave _less_ cooperati…

Decision Making

Multi-Agent, Human-Agent and Beyond: A Survey on Cooperation in Social Dilemmas

2024-02-27 · Chunjiang Mu, Hao Guo, Yang Chen, Chen Shen 외

The study of cooperation within social dilemmas has long been a fundamental topic across various disciplines, including computer science and social science. Recent advancements in Artificial Intelligence (AI) have signif…

Birds of a Feather Flock Together: A Close Look at Cooperation Emergence via Multi-Agent RL

2021-04-23 · Heng Dong, Tonghan Wang, Jiayuan Liu, Chi Han 외

How cooperation emerges is a long-standing and interdisciplinary problem. Game-theoretical studies on social dilemmas reveal that altruistic incentives are critical to the emergence of cooperation but their analyses are …

Multi-agent Reinforcement Learning

Inequity aversion improves cooperation in intertemporal social dilemmas

2018-03-23 · NeurIPS 2018 12 · Edward Hughes, Joel Z. Leibo, Matthew G. Phillips, Karl Tuyls 외

Groups of humans are often able to find ways to cooperate with one another in complex, temporally extended social dilemmas. Models based on behavioral economics are only able to explain this phenomenon for unrealistic st…

Multi-agent Reinforcement LearningReinforcement Learning