Multi-Agent Reinforcement Learning for Pragmatic Communication and Control

2023-02-28 · Federico Mason, Federico Chiariotti, Andrea Zanella, Petar Popovski

The automation of factories and manufacturing processes has been accelerating over the past few years, boosted by the Industry 4.0 paradigm, including diverse scenarios with mobile, flexible agents. Efficient coordination between mobile robots requires reliable wireless transmission in highly dynamic environments, often with strict timing requirements. Goal-oriented communication is a possible solution for this problem: communication decisions should be optimized for the target control task, providing the information that is most relevant to decide which action to take. From the control perspective, networked control design takes the communication impairments into account in its optmization of physical actions. In this work, we propose a joint design that combines goal-oriented communication and networked control into a single optimization model, an extension of a multiagent POMDP which we call Cyber-Physical POMDP (CP-POMDP). The model is flexible enough to represent several swarm and cooperative scenarios, and we illustrate its potential with two simple reference scenarios with a single agent and a set of supporting sensors. Joint training of the communication and control systems can significantly improve the overall performance, particularly if communication is severely constrained, and can even lead to implicit coordination of communication actions.

📄 PDF Abstract BibTeX arXiv:2302.14399

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Incorporating Pragmatic Reasoning Communication into Emergent Language

2020-06-07 · NeurIPS 2020 12 · Yipeng Kang, Tonghan Wang, Gerard de Melo

Emergentism and pragmatics are two research fields that study the dynamics of linguistic communication along substantially different timescales and intelligence levels. From the perspective of multi-agent reinforcement l…

Multi-agent Reinforcement Learning Reinforcement Learning (RL)Starcraft Starcraft II

Emergence of Pragmatics from Referential Game between Theory of Mind Agents

2020-01-21 · Luyao Yuan, Zipeng Fu, Jingyue Shen, Lu Xu 외

Pragmatics studies how context can contribute to language meanings. In human communication, language is never interpreted out of context, and sentences can usually convey more information than their literal meanings. How…

Reinforcement Learning Reinforcement Learning (RL)

Pragmatic Reasoning in Structured Signaling Games

2023-05-17 · Emil Carlsson, Devdatt Dubhashi

In this work we introduce a structured signaling game, an extension of the classical signaling game with a similarity structure between meanings in the context, along with a variant of the Rational Speech Act (RSA) frame…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Pragmatic Communication in Multi-Agent Collaborative Perception

2024-01-23 · Yue Hu, Xianghe Pang, Xiaoqi Qin, Yonina C. Eldar 외

Collaborative perception allows each agent to enhance its perceptual abilities by exchanging messages with others. It inherently results in a trade-off between perception ability and communication costs. Previous works t…

3D Object Detection object-detection Object Detection

PACE: A Pragmatic Agent for Enhancing Communication Efficiency Using Large Language Models

2024-01-30 · Jiaxuan Li, Minxi Yang, Dahua Gao, Wenlong Xu 외

Current communication technologies face limitations in terms of theoretical capacity, spectrum availability, and power resources. Pragmatic communication, leveraging terminal intelligence for selective data transmission,…