Active Legibility in Multiagent Reinforcement Learning

2024-10-28 · Yanyu Liu, Yinghui Pan, Yifeng Zeng, Biyang Ma, Doshi Prashant

A multiagent sequential decision problem has been seen in many critical applications including urban transportation, autonomous driving cars, military operations, etc. Its widely known solution, namely multiagent reinforcement learning, has evolved tremendously in recent years. Among them, the solution paradigm of modeling other agents attracts our interest, which is different from traditional value decomposition or communication mechanisms. It enables agents to understand and anticipate others' behaviors and facilitates their collaboration. Inspired by recent research on the legibility that allows agents to reveal their intentions through their behavior, we propose a multiagent active legibility framework to improve their performance. The legibility-oriented framework allows agents to conduct legible actions so as to help others optimise their behaviors. In addition, we design a series of problem domains that emulate a common scenario and best characterize the legibility in multiagent reinforcement learning. The experimental results demonstrate that the new framework is more efficient and costs less training time compared to several multiagent reinforcement learning algorithms.

📄 PDF Abstract BibTeX arXiv:2410.20954

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving reinforcement-learning Reinforcement Learning

Game-Theoretical Perspectives on Active Equilibria: A Preferred Solution Concept over Nash Equilibria

2022-10-28 · Dong-Ki Kim, Matthew Riemer, Miao Liu, Jakob N. Foerster 외

Multiagent learning settings are inherently more difficult than single-agent learning because each agent interacts with other simultaneously learning agents in a shared environment. An effective approach in multiagent re…

Deep Multiagent Reinforcement Learning: Challenges and Directions

2021-06-29 · Annie Wong, Thomas Bäck, Anna V. Kononova, Aske Plaat

This paper surveys the field of deep multiagent reinforcement learning. The combination of deep neural networks with reinforcement learning has gained increased traction in recent years and is slowly shifting the focus f…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sociology

"Guess what I'm doing": Extending legibility to sequential decision tasks

2022-09-19 · Miguel Faria, Francisco S. Melo, Ana Paiva

In this paper we investigate the notion of legibility in sequential decision tasks under uncertainty. Previous works that extend legibility to scenarios beyond robot motion either focus on deterministic settings or are c…

reinforcement-learning Reinforcement Learning (RL)

Model-based Reinforcement Learning for Decentralized Multiagent Rendezvous

2020-03-15 · Rose E. Wang, J. Chase Kew, Dennis Lee, Tsang-Wei Edward Lee 외

Collaboration requires agents to align their goals on the fly. Underlying the human ability to align goals with other agents is their ability to predict the intentions of others and actively update their own plans. We pr…

model Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning+1

A Survey and Critique of Multiagent Deep Reinforcement Learning

2018-10-12 · Pablo Hernandez-Leal, Bilal Kartal, Matthew E. Taylor

Deep reinforcement learning (RL) has achieved outstanding results in recent years. This has led to a dramatic increase in the number of applications and methods. Recent works have explored learning beyond single-agent sc…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1