Minimizing AoI in Resource-Constrained Multi-Source Relaying Systems with Stochastic Arrivals
We consider a multi-source relaying system where the sources independently and randomly generate status update packets which are sent to the destination with the aid of a bufferaided relay through unreliable links. We formulate a stochastic optimization problem aiming to minimize the sum average age of information (AAoI) of sources under per-slot transmission capacity constraints and a long-run average resource constraint. To solve the problem, we recast it as a constrained Markov decision process (CMDP) problem and adopt the Lagrangian method. We analyze the structure of an optimal policy for the resulting MDP problem that possesses a switching-type structure. We propose an algorithm that obtains a stationary deterministic near-optimal policy, establishing a benchmark for the system. Simulation results show the effectiveness of our algorithm compared to benchmark algorithms.
Code (0)
등록된 구현이 없습니다.
Tasks
Stochastic OptimizationSimilar Papers 제목 키워드 기반
Minimizing the AoI in Resource-Constrained Multi-Source Relaying Systems: Dynamic and Learning-based Scheduling
We consider a multi-source relaying system where independent sources randomly generate status update packets which are sent to the destination with the aid of a relay through unreliable links. We develop transmission sch…
Deep Reinforcement LearningSchedulingStochastic OptimizationFully Digital and Hybrid Beamforming Design For Millimeter-Wave MIMO-OFDM Two-Way Relaying Systems
In this work, we consider the design of hybrid analog-digital (HAD) multi-carrier MIMO-OFDM two-way relaying systems, where the relay station is equipped with a HAD amplify-and-forward architecture and every mobile stati…
Tera-SpaceCom: GNN-based Deep Reinforcement Learning for Joint Resource Allocation and Task Offloading in TeraHertz Band Space Networks
Terahertz (THz) space communications (Tera-SpaceCom) is envisioned as a promising technology to enable various space science and communication applications. Mainly, the realm of Tera-SpaceCom consists of THz sensing for …
Deep Reinforcement LearningEdge-computingGraph Neural NetworkEnergy-Efficient Resource Allocation in Multi-UAV-Assisted Two-Stage Edge Computing for Beyond 5G Networks
Unmanned aerial vehicle (UAV)-assisted multiaccess edge computing (MEC) has become one promising solution for energy-constrained devices to run the applications with high computation demand and stringent delay requirem…
Edge-computingImplementing Admittance Relaying for Microgrid Protection
The rapid increase of distributed energy resources has led to the widespread deployment of microgrids. These flexible and efficient local energy grids are able to operate in both grid-connected mode and islanded mode; th…