paper-with-me

홈 › Papers

Demand-Aware Beam Hopping and Power Allocation for Load Balancing in Digital Twin empowered LEO Satellite Networks

2024-10-29 · Ruili Zhao, Jun Cai, Jiangtao Luo, Junpeng Gao, Yongyi Ran

Low-Earth orbit (LEO) satellites utilizing beam hopping (BH) technology offer extensive coverage, low latency, high bandwidth, and significant flexibility. However, the uneven geographical distribution and temporal variability of ground traffic demands, combined with the high mobility of LEO satellites, present significant challenges for efficient beam resource utilization. Traditional BH methods based on GEO satellites fail to address issues such as satellite interference, overlapping coverage, and mobility. This paper explores a Digital Twin (DT)-based collaborative resource allocation network for multiple LEO satellites with overlapping coverage areas. A two-tier optimization problem, focusing on load balancing and cell service fairness, is proposed to maximize throughput and minimize inter-cell service delay. The DT layer optimizes the allocation of overlapping coverage cells by designing BH patterns for each satellite, while the LEO layer optimizes power allocation for each selected service cell. At the DT layer, an Actor-Critic network is deployed on each agent, with a global critic network in the cloud center. The A3C algorithm is employed to optimize the DT layer. Concurrently, the LEO layer optimization is performed using a Multi-Agent Reinforcement Learning algorithm, where each beam functions as an independent agent. The simulation results show that this method reduces satellite load disparity by about 72.5% and decreases the average delay to 12ms. Additionally, our approach outperforms other benchmarks in terms of throughput, ensuring a better alignment between offered and requested data.

📄 PDF Abstract BibTeX arXiv:2411.08896

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessMulti-agent Reinforcement Learning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Entropy Regularization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
A3C A3C, Asynchronous Advantage Actor Critic, is a policy gradient algorithm in reinforcement learning that maintains a policy $\pi\left(a\_{t}\mid{s}\_{t}; \theta\right)$ and…

Similar Papers 제목 키워드 기반

Multi-Satellite Beam Hopping and Power Allocation Using Deep Reinforcement Learning

2025-01-04 · Xia Xie, Kexin Fan, Wenfeng Deng, Nikolaos Pappas 외

In non-geostationary orbit (NGSO) satellite communication systems, effectively utilizing beam hopping (BH) technology is crucial for addressing uneven traffic demands. However, optimizing beam scheduling and resource all…

Deep Reinforcement LearningScheduling

GEO Payload Power Minimization: Joint Precoding and Beam Hopping Design

2022-08-22 · Vu Nguyen Ha, Ti Ti Nguyen, Eva Lagunas, Juan Carlos Merlano Duncan 외

This paper aims to jointly determine linear precoding (LP) vectors, beam hopping (BH), and discrete DVB-S2X transmission rates for the GEO satellite communication systems to minimize the payload power consumption and sat…

compressed sensing

Joint Load and Capacity Scheduling for Flexible Radio Resource Management of High-Throughput Satellites

2024-07-11 · Jia Zhuoya, Xiong Wei, Hao Hongxing, Liu Zheng 외

This work first explores using flexible beam-user mapping to optimize the beam service range and beam position, in order to adapt the non-uniform traffic demand to offer in high-throughput satellite (HTS) systems. Second…

ManagementScheduling

Large-Scale Beam Placement and Resource Allocation Design for MEO-Constellation SATCOM

2023-03-11 · Vu Nguyen Ha, Eva Lagunas, Tedros Salih Abdu, Haythem Chaker 외

This paper presents a centralized framework for optimizing the joint design of beam placement, power, and bandwidth allocation in an MEO satellite constellation to fulfill the heterogeneous traffic demands of a large num…

Clustering

Deep Reinforcement Learning Architecture for Continuous Power Allocation in High Throughput Satellites

2019-06-03 · Juan Jose Garau Luis, Markus Guerster, Inigo del Portillo, Edward Crawley 외

In the coming years, the satellite broadband market will experience significant increases in the service demand, especially for the mobility sector, where demand is burstier. Many of the next generation of satellites wil…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)