Learning-based sensing and computing decision for data freshness in edge computing-enabled networks
As the demand on artificial intelligence (AI)-based applications increases, the freshness of sensed data becomes crucial in the wireless sensor networks. Since those applications require a large amount of computation for processing the sensed data, it is essential to offload the computation load to the edge computing (EC) server. In this paper, we propose the sensing and computing decision (SCD) algorithms for data freshness in the EC-enabled wireless sensor networks. We define the {\eta}-coverage probability to show the probability of maintaining fresh data for more than {\eta} ratio of the network, where the spatial-temporal correlation of information is considered. We then propose the probability-based SCD for the single pre-charged sensor case with providing the optimal point after deriving the {\eta}-coverage probability. We also propose the reinforcement learning (RL)- based SCD by training the SCD policy of sensors for both the single pre-charged and multiple energy harvesting (EH) sensor cases, to make a real-time decision based on its observation. Our simulation results verify the performance of the proposed algorithms under various environment settings, and show that the RL-based SCD algorithm achieves higher performance compared to baseline algorithms for both the single pre-charged sensor and multiple EH sensor cases.
Code (0)
등록된 구현이 없습니다.
Tasks
Edge-computingReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Information Freshness-Aware Task Offloading in Air-Ground Integrated Edge Computing Systems
This paper studies the problem of information freshness-aware task offloading in an air-ground integrated multi-access edge computing system, which is deployed by an infrastructure provider (InP). A third-party real-time…
Deep Reinforcement LearningEdge-computingReinforcement Learning (RL)Minimizing Age of Information for Mobile Edge Computing Systems: A Nested Index Approach
Exploiting the computational heterogeneity of mobile devices and edge nodes, mobile edge computation (MEC) provides an efficient approach to achieving real-time applications that are sensitive to information freshness, b…
Edge-computingBlockchain-empowered Federated Learning for Healthcare Metaverses: User-centric Incentive Mechanism with Optimal Data Freshness
Given the revolutionary role of metaverses, healthcare metaverses are emerging as a transformative force, creating intelligent healthcare systems that offer immersive and personalized services. The healthcare metaverses …
Decision MakingFederated LearningPrivacy PreservingA Survey of Freshness-Aware Wireless Networking with Reinforcement Learning
The age of information (AoI) has become a central measure of data freshness in modern wireless systems, yet existing surveys either focus on classical AoI formulations or provide broad discussions of reinforcement learni…
Reinforcement LearningTrajectory PlanningAge-Based Scheduling for Mobile Edge Computing: A Deep Reinforcement Learning Approach
With the rapid development of Mobile Edge Computing (MEC), various real-time applications have been deployed to benefit people's daily lives. The performance of these applications relies heavily on the freshness of colle…
Deep Reinforcement LearningEdge-computingReinforcement Learning (RL)Scheduling