paper-with-me

홈 › Papers

Optimization of Link Configuration for Satellite Communication Using Reinforcement Learning

2025-01-14 · Tobias Rohe, Michael Kölle, Jan Matheis, Rüdiger Höpfl, Leo Sünkel, Claudia Linnhoff-Popien

Satellite communication is a key technology in our modern connected world. With increasingly complex hardware, one challenge is to efficiently configure links (connections) on a satellite transponder. Planning an optimal link configuration is extremely complex and depends on many parameters and metrics. The optimal use of the limited resources, bandwidth and power of the transponder is crucial. Such an optimization problem can be approximated using metaheuristic methods such as simulated annealing, but recent research results also show that reinforcement learning can achieve comparable or even better performance in optimization methods. However, there have not yet been any studies on link configuration on satellite transponders. In order to close this research gap, a transponder environment was developed as part of this work. For this environment, the performance of the reinforcement learning algorithm PPO was compared with the metaheuristic simulated annealing in two experiments. The results show that Simulated Annealing delivers better results for this static problem than the PPO algorithm, however, the research in turn also underlines the potential of reinforcement learning for optimization problems.

📄 PDF Abstract BibTeX arXiv:2501.08220

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Similar Papers 제목 키워드 기반

Collaborative Ground-Space Communications via Evolutionary Multi-objective Deep Reinforcement Learning

2024-04-11 · Jiahui Li, Geng Sun, Qingqing Wu, Dusit Niyato 외

In this paper, we propose a distributed collaborative beamforming (DCB)-based uplink communication paradigm for enabling ground-space direct communications. Specifically, DCB treats the terminals that are unable to estab…

Deep Reinforcement Learning

Flexible Robust Beamforming for Multibeam Satellite Downlink using Reinforcement Learning

2024-02-26 · Alea Schröder, Steffen Gracla, Maik Röper, Dirk Wübben 외

Low Earth Orbit (LEO) satellite-to-handheld connections herald a new era in satellite communications. Space-Division Multiple Access (SDMA) precoding is a method that mitigates interference among satellite beams, boostin…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

A hybrid beamforming design for massive MIMO LEO satellite communications

2021-04-22 · Joan Palacios, Nuria Gonzalez-Prelcic, Carlos Mosquera, Takayuki Shimizu 외

5G and future cellular networks intend to incorporate low earth orbit (LEO) satellite communication systems (SatCom) to solve the coverage and availability problems that cannot be addressed by satellite-based or ground-b…

A Mapping of Triangular Block Interleavers to DRAM for Optical Satellite Communication

2023-12-04 · Lukas Steiner, Timo Lehnigk-Emden, Markus Fehrenz, Norbert Wehn

Communication in optical downlinks of low earth orbit (LEO) satellites requires interleaving to enable reliable data transmission. These interleavers are orders of magnitude larger than conventional interleavers utilized…

Joint AoI and Handover Optimization in Space-Air-Ground Integrated Network

2025-09-16 · Zifan Lang, Guixia Liu, Geng Sun, Jiahui Li 외 arxiv

Despite the widespread deployment of terrestrial networks, providing reliable communication services to remote areas and maintaining connectivity during emergencies remains challenging. Low Earth orbit (LEO) satellite co…

Reinforcement Learning