IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning

2018-09-20 · Yize Chen, Hao Wang

The prosperity of smart mobile devices has made mobile crowdsensing (MCS) a promising paradigm for completing complex sensing and computation tasks. In the past, great efforts have been made on the design of incentive mechanisms and task allocation strategies from MCS platform's perspective to motivate mobile users' participation. However, in practice, MCS participants face many uncertainties coming from their sensing environment as well as other participants' strategies, and how do they interact with each other and make sensing decisions is not well understood. In this paper, we take MCS participants' perspective to derive an online sensing policy to maximize their payoffs via MCS participation. Specifically, we model the interactions of mobile users and sensing environments as a multi-agent Markov decision process. Each participant cannot observe others' decisions, but needs to decide her effort level in sensing tasks only based on local information, e.g., its own record of sensed signals' quality. To cope with the stochastic sensing environment, we develop an intelligent crowdsensing algorithm IntelligentCrowd by leveraging the power of multi-agent reinforcement learning (MARL). Our algorithm leads to the optimal sensing policy for each user to maximize the expected payoff against stochastic sensing environments, and can be implemented at individual participant's level in a distributed fashion. Numerical simulations demonstrate that IntelligentCrowd significantly improves users' payoffs in sequential MCS tasks under various sensing dynamics.

📄 PDF Abstract BibTeX arXiv:1809.07830

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Heterogeneous Multi-agent Collaboration in UAV-assisted Mobile Crowdsensing Networks

2025-09-28 · Xianyang Deng, Wenshuai Liu, Yaru FuB, Qi Zhu arxiv

Unmanned aerial vehicles (UAVs)-assisted mobile crowdsensing (MCS) has emerged as a promising paradigm for data collection. However, challenges such as spectrum scarcity, device heterogeneity, and user mobility hinder ef…

Stochastic Optimization Reinforcement Learning Trajectory Planning

Social-Aware Incentive Mechanism for VehicularCrowdsensing by Deep Reinforcement Learning

2020-08-21 · IEEE Transactions on Intelligent Transportation Systems 2020 8 · Yinuo Zhao, Chi Harold Liu

Vehicular crowdsensing (VCS) takes the advantage of vehicles’ mobility and exploits both the crowd wisdom and sensing abilities offered by vehicle drivers’ carried smart mobile devices and on-board sensors to accomplish …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Cloud-based Federated Boosting for Mobile Crowdsensing

2020-05-09 · Zhuzhu Wang, Yilong Yang, Yang Liu, Ximeng Liu 외

The application of federated extreme gradient boosting to mobile crowdsensing apps brings several benefits, in particular high performance on efficiency and classification. However, it also brings a new challenge for dat…

Federated Learning General Classification Generative Adversarial Network Privacy Preserving+1

Tri-Select: A Multi-Stage Visual Data Selection Framework for Mobile Visual Crowdsensing

2025-12-18 · Jiayu Zhang, Kaixing Zhao, Tianhao Shao, Bin Guo 외 arxiv

Mobile visual crowdsensing enables large-scale, fine-grained environmental monitoring through the collection of images from distributed mobile devices. However, the resulting data is often redundant and heterogeneous due…

Federated Reinforcement Learning for Efficient Mobile Crowdsensing under Incomplete Information

2026-05-04 · Sumedh J. Dongare, Patrick Weber, Andrea Ortiz, Walid Saad 외 arxiv

Mobile crowdsensing (MCS) is a distributed sensing architecture that utilizes existing sensors on mobile units (MUs) to perform sensing tasks. A mobile crowdsensing platform (MCSP) publishes the sensing tasks and the MUs…

Reinforcement Learning Federated Learning