paper-with-me

홈 › Papers

Learning in Cooperative Multiagent Systems Using Cognitive and Machine Models

2023-08-18 · Thuy Ngoc Nguyen, Duy Nhat Phan, Cleotilde Gonzalez

Developing effective Multi-Agent Systems (MAS) is critical for many applications requiring collaboration and coordination with humans. Despite the rapid advance of Multi-Agent Deep Reinforcement Learning (MADRL) in cooperative MAS, one major challenge is the simultaneous learning and interaction of independent agents in dynamic environments in the presence of stochastic rewards. State-of-the-art MADRL models struggle to perform well in Coordinated Multi-agent Object Transportation Problems (CMOTPs), wherein agents must coordinate with each other and learn from stochastic rewards. In contrast, humans often learn rapidly to adapt to nonstationary environments that require coordination among people. In this paper, motivated by the demonstrated ability of cognitive models based on Instance-Based Learning Theory (IBLT) to capture human decisions in many dynamic decision making tasks, we propose three variants of Multi-Agent IBL models (MAIBL). The idea of these MAIBL algorithms is to combine the cognitive mechanisms of IBLT and the techniques of MADRL models to deal with coordination MAS in stochastic environments from the perspective of independent learners. We demonstrate that the MAIBL models exhibit faster learning and achieve better coordination in a dynamic CMOTP task with various settings of stochastic rewards compared to current MADRL models. We discuss the benefits of integrating cognitive insights into MADRL models.

📄 PDF Abstract BibTeX arXiv:2308.09219

Code (1)

ddm-lab/greedy-hysteretic-lenient-maibl 공식 구현

Tasks

Decision MakingDeep Reinforcement LearningLearning Theory

Methods 이 논문이 사용한 방법론

MAS This optimizer mix ADAM and SGD creating the MAS optimizer.

Similar Papers 제목 키워드 기반

An Optimal Rewiring Strategy for Reinforcement Social Learning in Cooperative Multiagent Systems

2018-05-13 · Hongyao Tang, Li Wang, Zan Wang, Tim Baarslag 외

Multiagent coordination in cooperative multiagent systems (MASs) has been widely studied in both fixed-agent repeated interaction setting and the static social learning framework. However, two aspects of dynamics in real…

Weighted Double Deep Multiagent Reinforcement Learning in Stochastic Cooperative Environments

2018-02-23 · Yan Zheng, Jianye Hao, Zongzhang Zhang

Recently, multiagent deep reinforcement learning (DRL) has received increasingly wide attention. Existing multiagent DRL algorithms are inefficient when facing with the non-stationarity due to agents update their policie…

Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning+1

Coordinating Multiagent Industrial Symbiosis

2020-06-02 · Vahid Yazdanpanah, Devrim Murat Yazan, W. Henk M. Zijm

We present a formal multiagent framework for coordinating a class of collaborative industrial practices called Industrial Symbiotic Networks (ISNs) as cooperative games. The game-theoretic formulation of ISNs enables sys…

Differential Privacy in Cooperative Multiagent Planning

2023-01-20 · Bo Chen, Calvin Hawkins, Mustafa O. Karabag, Cyrus Neary 외

Privacy-aware multiagent systems must protect agents' sensitive data while simultaneously ensuring that agents accomplish their shared objectives. Towards this goal, we propose a framework to privatize inter-agent commun…

Decision MakingSequential Decision Making

Exploring the Benefits of Teams in Multiagent Learning

2022-05-04 · David Radke, Kate Larson, Tim Brecht

For problems requiring cooperation, many multiagent systems implement solutions among either individual agents or across an entire population towards a common goal. Multiagent teams are primarily studied when in conflict…

Reinforcement Learning (RL)