Learning to Minimize Age of Information over an Unreliable Channel with Energy Harvesting
The time average expected age of information (AoI) is studied for status updates sent over an error-prone channel from an energy-harvesting transmitter with a finite-capacity battery. Energy cost of sensing new status updates is taken into account as well as the transmission energy cost better capturing practical systems. The optimal scheduling policy is first studied under the hybrid automatic repeat request (HARQ) protocol when the channel and energy harvesting statistics are known, and the existence of a threshold-based optimal policy is shown. For the case of unknown environments, average-cost reinforcement-learning algorithms are proposed that learn the system parameters and the status update policy in real-time. The effectiveness of the proposed methods is demonstrated through numerical results.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement Learning (RL)SchedulingSimilar Papers 제목 키워드 기반
Deep Reinforcement Learning Based Power Allocation for Minimizing AoI and Energy Consumption in MIMO-NOMA IoT Systems
Multi-input multi-out and non-orthogonal multiple access (MIMO-NOMA) internet-of-things (IoT) systems can improve channel capacity and spectrum efficiency distinctly to support the real-time applications. Age of informat…
Deep Reinforcement LearningAverage AoI Minimization for Energy Harvesting Relay-aided Status Update Network Using Deep Reinforcement Learning
A dual-hop status update system aided by energy harvesting (EH) relays with finite data and energy buffers is studied in this work. To achieve timely status updates, the best relays should be selected to minimize the ave…
Deep Reinforcement LearningRemote Estimation over Packet-Dropping Wireless Channels with Partial State Information
In this paper, we study the design of an optimal transmission policy for remote state estimation over packet-dropping wireless channels with imperfect channel state information. A smart sensor uses a Kalman filter to est…
State EstimationAge Optimal Sampling for Unreliable Channels under Unknown Channel Statistics
In this paper, we study a system in which a sensor forwards status updates to a receiver through an error-prone channel, while the receiver sends the transmission results back to the sensor via a reliable channel. Both c…
Query-Age-Optimal Scheduling under Sampling and Transmission Constraints
This letter provides query-age-optimal joint sampling and transmission scheduling policies for a heterogeneous status update system, consisting of a stochastic arrival and a generate-at-will source, with an unreliable ch…
Scheduling