Structure-Enhanced Deep Reinforcement Learning for Optimal Transmission Scheduling

2022-11-20 · Jiazheng Chen, Wanchun Liu, Daniel E. Quevedo, Yonghui Li, Branka Vucetic

Remote state estimation of large-scale distributed dynamic processes plays an important role in Industry 4.0 applications. In this paper, by leveraging the theoretical results of structural properties of optimal scheduling policies, we develop a structure-enhanced deep reinforcement learning (DRL) framework for optimal scheduling of a multi-sensor remote estimation system to achieve the minimum overall estimation mean-square error (MSE). In particular, we propose a structure-enhanced action selection method, which tends to select actions that obey the policy structure. This explores the action space more effectively and enhances the learning efficiency of DRL agents. Furthermore, we introduce a structure-enhanced loss function to add penalty to actions that do not follow the policy structure. The new loss function guides the DRL to converge to the optimal policy structure quickly. Our numerical results show that the proposed structure-enhanced DRL algorithms can save the training time by 50% and reduce the remote estimation MSE by 10% to 25%, when compared to benchmark DRL algorithms.

📄 PDF Abstract BibTeX arXiv:2211.10827

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)SchedulingState Estimation

Structure-Enhanced DRL for Optimal Transmission Scheduling

2022-12-24 · Jiazheng Chen, Wanchun Liu, Daniel E. Quevedo, Saeed R. Khosravirad 외

Remote state estimation of large-scale distributed dynamic processes plays an important role in Industry 4.0 applications. In this paper, we focus on the transmission scheduling problem of a remote estimation system. Fir…

Deep Reinforcement Learning Scheduling State Estimation

Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach

2022-12-27 · Yang Li, Fanjin Bu, Yuanzheng Li, Chao Long

Multi-uncertainties from power sources and loads have brought significant challenges to the stable demand supply of various resources at islands. To address these challenges, a comprehensive scheduling framework is propo…

Computational Efficiency Decision Making Deep Reinforcement Learning reinforcement-learning+3

Semantic-aware Transmission Scheduling: a Monotonicity-driven Deep Reinforcement Learning Approach

2023-05-23 · Jiazheng Chen, Wanchun Liu, Daniel Quevedo, Yonghui Li 외

For cyber-physical systems in the 6G era, semantic communications connecting distributed devices for dynamic control and remote state estimation are required to guarantee application-level performance, not merely focus o…

Decision Making Deep Reinforcement Learning reinforcement-learning Scheduling+1

Accelerated Structure-Aware Reinforcement Learning for Delay-Sensitive Energy Harvesting Wireless Sensors

2018-07-22 · Nikhilesh Sharma, Nicholas Mastronarde, Jacob Chakareski

We investigate an energy-harvesting wireless sensor transmitting latency-sensitive data over a fading channel. The sensor injects captured data packets into its transmission queue and relies on ambient energy harvested f…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Deep Reinforcement Learning for Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks

2018-10-03 · Tran The Anh, Nguyen Cong Luong, Dusit Niyato, Ying-Chang Liang 외

In an RF-powered backscatter cognitive radio network, multiple secondary users communicate with a secondary gateway by backscattering or harvesting energy and actively transmitting their data depending on the primary cha…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1