A Safe Reinforcement Learning Architecture for Antenna Tilt Optimisation

2020-12-02 · Erik Aumayr, Saman Feghhi, Filippo Vannella, Ezeddin Al Hakim, Grigorios Iakovidis

Safe interaction with the environment is one of the most challenging aspects of Reinforcement Learning (RL) when applied to real-world problems. This is particularly important when unsafe actions have a high or irreversible negative impact on the environment. In the context of network management operations, Remote Electrical Tilt (RET) optimisation is a safety-critical application in which exploratory modifications of antenna tilt angles of base stations can cause significant performance degradation in the network. In this paper, we propose a modular Safe Reinforcement Learning (SRL) architecture which is then used to address the RET optimisation in cellular networks. In this approach, a safety shield continuously benchmarks the performance of RL agents against safe baselines, and determines safe antenna tilt updates to be performed on the network. Our results demonstrate improved performance of the SRL agent over the baseline while ensuring the safety of the performed actions.

📄 PDF Abstract BibTeX arXiv:2012.01296

Code (0)

등록된 구현이 없습니다.

Tasks

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Remote Electrical Tilt Optimization via Safe Reinforcement Learning

2020-10-12 · Filippo Vannella, Grigorios Iakovidis, Ezeddin Al Hakim, Erik Aumayr 외

Remote Electrical Tilt (RET) optimization is an efficient method for adjusting the vertical tilt angle of Base Stations (BSs) antennas in order to optimize Key Performance Indicators (KPIs) of the network. Reinforcement …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning+1

Safe RAN control: A Symbolic Reinforcement Learning Approach

2021-06-03 · Alexandros Nikou, Anusha Mujumdar, Vaishnavi Sundararajan, Marin Orlic 외

In this paper, we present a Symbolic Reinforcement Learning (SRL) based architecture for safety control of Radio Access Network (RAN) applications. In particular, we provide a purely automated procedure in which a user c…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Self-Learning

Base Station Antenna Uptilt Optimization for Cellular-Connected Drone Corridors

2021-07-02 · Sung Joon Maeng, Md Moin Uddin Chowdhury, İsmail Güvenç, Arupjyoti Bhuyan 외

The concept of drone corridors is recently getting more attention to enable connected, safe, and secure flight zones in the national airspace. To support beyond visual line of sight (BVLOS) operations of aerial vehicles …

Multi-agent Reinforcement Learning with Graph Q-Networks for Antenna Tuning

2023-01-20 · Maxime Bouton, Jaeseong Jeong, Jose Outes, Adriano Mendo 외

Future generations of mobile networks are expected to contain more and more antennas with growing complexity and more parameters. Optimizing these parameters is necessary for ensuring the good performance of the network.…

Graph Neural Network Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Ensuring Reliable Connectivity to Cellular-Connected UAVs with Up-tilted Antennas and Interference Coordination

2021-08-11 · Md Moin Uddin Chowdhury, Ismail Guvenc, Walid Saad, Arupjyoti Bhuyan

To integrate unmanned aerial vehicles (UAVs) in future large-scale deployments, a new wireless communication paradigm, namely, the cellular-connected UAV has recently attracted interest. However, the line-of-sight domina…