Deep Reinforcement Learning Architecture for Continuous Power Allocation in High Throughput Satellites

2019-06-03 · Juan Jose Garau Luis, Markus Guerster, Inigo del Portillo, Edward Crawley, Bruce Cameron

In the coming years, the satellite broadband market will experience significant increases in the service demand, especially for the mobility sector, where demand is burstier. Many of the next generation of satellites will be equipped with numerous degrees of freedom in power and bandwidth allocation capabilities, making manual resource allocation impractical and inefficient. Therefore, it is desirable to automate the operation of these highly flexible satellites. This paper presents a novel power allocation approach based on Deep Reinforcement Learning (DRL) that represents the problem as continuous state and action spaces. We make use of the Proximal Policy Optimization (PPO) algorithm to optimize the allocation policy for minimum Unmet System Demand (USD) and power consumption. The performance of the algorithm is analyzed through simulations of a multibeam satellite system, which show promising results for DRL to be used as a dynamic resource allocation algorithm.

📄 PDF Abstract BibTeX arXiv:1906.00571

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Satellite Beam Hopping and Power Allocation Using Deep Reinforcement Learning

2025-01-04 · Xia Xie, Kexin Fan, Wenfeng Deng, Nikolaos Pappas 외

In non-geostationary orbit (NGSO) satellite communication systems, effectively utilizing beam hopping (BH) technology is crucial for addressing uneven traffic demands. However, optimizing beam scheduling and resource all…

Deep Reinforcement Learning Scheduling

A Prescriptive Dirichlet Power Allocation Policy with Deep Reinforcement Learning

2022-01-20 · Yuan Tian, Minghao Han, Chetan Kulkarni, Olga Fink

Prescribing optimal operation based on the condition of the system and, thereby, potentially prolonging the remaining useful lifetime has a large potential for actively managing the availability, maintenance and costs of…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks

2020-12-19 · Yasar Sinan Nasir, Dongning Guo

A wireless network operator typically divides the radio spectrum it possesses into a number of subbands. In a cellular network those subbands are then reused in many cells. To mitigate co-channel interference, a joint sp…

Deep Reinforcement Learning Management reinforcement-learning Reinforcement Learning+1

Autonomous Resource Management in Microservice Systems via Reinforcement Learning

2025-07-17 · Yujun Zou, Nia Qi, Yingnan Deng, Zhihao Xue 외

This paper proposes a reinforcement learning-based method for microservice resource scheduling and optimization, aiming to address issues such as uneven resource allocation, high latency, and insufficient throughput in t…

Management reinforcement-learning Reinforcement Learning Scheduling

Graph Neural Network Aided Deep Reinforcement Learning for Resource Allocation in Dynamic Terahertz UAV Networks

2025-05-08 · Zhifeng Hu, Chong Han

Terahertz (THz) unmanned aerial vehicle (UAV) networks with flexible topologies and ultra-high data rates are expected to empower numerous applications in security surveillance, disaster response, and environmental monit…

Deep Reinforcement Learning Disaster Response Graph Neural Network