Average AoI Minimization for Energy Harvesting Relay-aided Status Update Network Using Deep Reinforcement Learning
A dual-hop status update system aided by energy harvesting (EH) relays with finite data and energy buffers is studied in this work. To achieve timely status updates, the best relays should be selected to minimize the average age of information (AoI), which is a recently proposed metric to evaluate information freshness. The average AoI minimization can be formulated as a Markov decision process (MDP), but the state space for capturing channel and buffer evolution grows exponentially with the number of relays, leading to high solution complexity. We propose a relay selection (RS) scheme based on deep reinforcement learning (DRL) according to the instantaneous channel packet freshness and buffer information of each relay. Simulation results show a significant improvement of the proposed DRL-based RS scheme over state-of-art approaches.
Code (1)
Tasks
Deep Reinforcement LearningSimilar Papers 제목 키워드 기반
UAV-Enabled IoT Networks: A SWIPT Energy Harvesting Architecture with Relay Support for Disaster Response
Due to the wide application of unmanned aerial vehicles (UAVs) as relays to establish Disaster Response Networks (DRNs), an effective model of energy harvesting (EH) and energy consumption for the UAV-aided Disaster Resp…
Disaster ResponseWireless Power Transfer in Cooperative DF Relaying Networks with Log-Normal Fading
Energy-harvesting and wireless power transfer in cooperative relaying networks have recently attracted a considerable amount of research attention. Most of the existing work on this topic however focuses on Rayleigh fadi…
Half-Duplex and Full-Duplex AF and DF Relaying with Energy-Harvesting in Log-Normal Fading
Energy-harvesting (EH) and wireless power transfer in cooperative relaying networks have recently attracted a considerable amount of research attention. Most of the existing work on this topic however focuses on Rayleigh…
Latency Optimization for Wireless Federated Learning in Multihop Networks
In this paper, we study a novel latency minimization problem in wireless federated learning (FL) across multi-hop networks. The system comprises multiple routes, each integrating leaf and relay nodes for FL model trainin…
Federated LearningOptimizing Throughput in a MIMO System with a Self-sustained Relay and Non-uniform Power Splitting
We present a novel approach to maximizing the transmission rate in a MIMO relay system, where all nodes are equipped with multiple antennas and the relay is self-sustained by harvesting energy. We formulate an optimizati…