A Multi-Agent Reinforcement Learning Approach for Cooperative Air-Ground-Human Crowdsensing in Emergency Rescue

2025-05-11 · Wenhao Lu, Zhengqiu Zhu, Yong Zhao, Yonglin Tian, Junjie Zeng, Jun Zhang, Zhong Liu, Fei-Yue Wang

Mobile crowdsensing is evolving beyond traditional human-centric models by integrating heterogeneous entities like unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs). Optimizing task allocation among these diverse agents is critical, particularly in challenging emergency rescue scenarios characterized by complex environments, limited communication, and partial observability. This paper tackles the Heterogeneous-Entity Collaborative-Sensing Task Allocation (HECTA) problem specifically for emergency rescue, considering humans, UAVs, and UGVs. We introduce a novel ``Hard-Cooperative'' policy where UGVs prioritize recharging low-battery UAVs, alongside performing their sensing tasks. The primary objective is maximizing the task completion rate (TCR) under strict time constraints. We rigorously formulate this NP-hard problem as a decentralized partially observable Markov decision process (Dec-POMDP) to effectively handle sequential decision-making under uncertainty. To solve this, we propose HECTA4ER, a novel multi-agent reinforcement learning algorithm built upon a Centralized Training with Decentralized Execution architecture. HECTA4ER incorporates tailored designs, including specialized modules for complex feature extraction, utilization of action-observation history via hidden states, and a mixing network integrating global and local information, specifically addressing the challenges of partial observability. Furthermore, theoretical analysis confirms the algorithm's convergence properties. Extensive simulations demonstrate that HECTA4ER significantly outperforms baseline algorithms, achieving an average 18.42% increase in TCR. Crucially, a real-world case study validates the algorithm's effectiveness and robustness in dynamic sensing scenarios, highlighting its strong potential for practical application in emergency response.

📄 PDF Abstract BibTeX arXiv:2505.06997

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Under UncertaintyMulti-agent Reinforcement LearningSequential Decision Making

MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotion

2025-08-14 · Qi Liu, Xiaopeng Zhang, Mingshan Tan, Shuaikang Ma 외 arxiv

This paper proposes a novel method to enhance locomotion for a single humanoid robot through cooperative-heterogeneous multi-agent deep reinforcement learning (MARL). While most existing methods typically employ single-a…

Multi-agent Reinforcement Learning

Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learning

2023-07-03 · Ini Oguntola, Joseph Campbell, Simon Stepputtis, Katia Sycara

The ability to model the mental states of others is crucial to human social intelligence, and can offer similar benefits to artificial agents with respect to the social dynamics induced in multi-agent settings. We presen…

Multi-agent Reinforcement Learning reinforcement-learning

Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning

2017-03-20 · ICCV 2017 10 · Abhishek Das, Satwik Kottur, José M. F. Moura, Stefan Lee 외

We introduce the first goal-driven training for visual question answering and dialog agents. Specifically, we pose a cooperative 'image guessing' game between two agents -- Qbot and Abot -- who communicate in natural lan…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+3

Inducing Cooperative behaviour in Sequential-Social dilemmas through Multi-Agent Reinforcement Learning using Status-Quo Loss

2020-01-15 · Pinkesh Badjatiya, Mausoom Sarkar, Abhishek Sinha, Siddharth Singh 외

In social dilemma situations, individual rationality leads to sub-optimal group outcomes. Several human engagements can be modeled as a sequential (multi-step) social dilemmas. However, in contrast to humans, Deep Reinfo…

Clustering Deep Reinforcement Learning Multi-agent Reinforcement Learning Reinforcement Learning

MA2QL: A Minimalist Approach to Fully Decentralized Multi-Agent Reinforcement Learning

2022-09-17 · Kefan Su, Siyuan Zhou, Jiechuan Jiang, Chuang Gan 외

Decentralized learning has shown great promise for cooperative multi-agent reinforcement learning (MARL). However, non-stationarity remains a significant challenge in fully decentralized learning. In the paper, we tackle…

Multi-agent Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning (RL)