Optimal Semantic-aware Sampling and Transmission in Energy Harvesting Systems Through the AoII
We study a real-time tracking problem in an energy harvesting status update system with a Markov source and an imperfect channel, considering both sampling and transmission costs. The problem primary challenge stems from the non-observability of the source due to the sampling cost. By using the age of incorrect information (AoII) as a semantic-aware performance metric, our main goal is to find an optimal policy that minimizes the time average AoII subject to an energy-causality constraint. To this end, a stochastic optimization problem is formulated and solved by modeling it as a partially observable Markov decision process (POMDP). More specifically, to solve the main problem, we use the notion of a belief state and cast the problem as a belief MDP problem. Then, for the perfect channel setup, we effectively truncate the corresponding belief space and solve the MDP problem using the relative value iteration method. For the general setup, a deep reinforcement learning policy is proposed. The simulation results show the efficacy of the derived policies in comparison to an AoI-optimal policy and an opportunistic baseline policy.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningStochastic OptimizationSimilar Papers 제목 키워드 기반
Semantic-aware Sampling and Transmission in Energy Harvesting Systems: A POMDP Approach
We address the problem of real-time remote tracking of a partially observable Markov source in an energy harvesting system with an unreliable communication channel. We consider both sampling and transmission costs. Diffe…
Deep Reinforcement LearningWhittle's index-based age-of-information minimization in multi-energy harvesting source networks
We consider the problem of source sampling and transmission scheduling for age-of-information minimization in a system consisting of multiple energy harvesting (EH) sources and a sink node. At each time, one of the sourc…
Q-LearningSchedulingSemantic Communications in Networked Systems: A Data Significance Perspective
We present our vision for a departure from the established way of architecting and assessing communication networks, by incorporating the semantics of information for communications and control in networked systems. We d…
compressed sensingDecision MakingResource Allocation for Semantic-Aware Mobile Edge Computing Systems
In this paper, a semantic-aware joint communication and computation resource allocation framework is proposed for mobile edge computing (MEC) systems. In the considered system, each terminal device (TD) has a computation…
Edge-computingManagementSemantic-aware Transmission Scheduling: a Monotonicity-driven Deep Reinforcement Learning Approach
For cyber-physical systems in the 6G era, semantic communications connecting distributed devices for dynamic control and remote state estimation are required to guarantee application-level performance, not merely focus o…
Decision MakingDeep Reinforcement Learningreinforcement-learningScheduling+1