A Reinforcement Learning Approach to Sensing Design in Resource-Constrained Wireless Networked Control Systems
In this paper, we consider a wireless network of smart sensors (agents) that monitor a dynamical process and send measurements to a base station that performs global monitoring and decision-making. Smart sensors are equipped with both sensing and computation, and can either send raw measurements or process them prior to transmission. Constrained agent resources raise a fundamental latency-accuracy trade-off. On the one hand, raw measurements are inaccurate but fast to produce. On the other hand, data processing on resource-constrained platforms generates accurate measurements at the cost of non-negligible computation latency. Further, if processed data are also compressed, latency caused by wireless communication might be higher for raw measurements. Hence, it is challenging to decide when and where sensors in the network should transmit raw measurements or leverage time-consuming local processing. To tackle this design problem, we propose a Reinforcement Learning approach to learn an efficient policy that dynamically decides when measurements are to be processed at each sensor. Effectiveness of our proposed approach is validated through a numerical simulation with case study on smart sensing motivated by the Internet of Drones.
Code (1)
Tasks
Decision MakingReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
IoV-Oriented Integrated Sensing, Computation, and Communication: System Design and Resource Allocation
—In future mobile communication systems, the deep integration of communication, sensing, and computation has become a new trend. This article paper designs an integrated sensing, computation, and communication (ISCC) sy…
Deep Reinforcement LearningEdge-computingIntegrated sensing and communicationISACFederated Multi Agent Deep Learning and Neural Networks for Advanced Distributed Sensing in Wireless Networks
Multi-agent deep learning (MADL), including multi-agent deep reinforcement learning (MADRL), distributed/federated training, and graph-structured neural networks, is becoming a unifying framework for decision-making and …
Reinforcement LearningIntrusion DetectionJCAS-MARL: Joint Communication and Sensing UAV Networks via Resource-Constrained Multi-Agent Reinforcement Learning
Multi-UAV networks are increasingly deployed for large-scale inspection and monitoring missions, where operational performance depends on the coordination of sensing reliability, communication quality, and energy constra…
Multi-agent Reinforcement LearningSecure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks
This paper proposes a blockchain-secured deep reinforcement learning (BC-DRL) optimization framework for {data management and} resource allocation in decentralized {wireless mobile edge computing (MEC)} networks. In our …
Deep Reinforcement LearningEdge-computingManagementModel-Free Design of Control Systems over Wireless Fading Channels
Wireless control systems replace traditional wired communication with wireless networks to exchange information between actuators, plants and sensors in a control system. The noise in wireless channels renders ideal cont…