Remote Electrical Tilt Optimization via Safe Reinforcement Learning

2020-10-12 · Filippo Vannella, Grigorios Iakovidis, Ezeddin Al Hakim, Erik Aumayr, Saman Feghhi

Remote Electrical Tilt (RET) optimization is an efficient method for adjusting the vertical tilt angle of Base Stations (BSs) antennas in order to optimize Key Performance Indicators (KPIs) of the network. Reinforcement Learning (RL) provides a powerful framework for RET optimization because of its self-learning capabilities and adaptivity to environmental changes. However, an RL agent may execute unsafe actions during the course of its interaction, i.e., actions resulting in undesired network performance degradation. Since the reliability of services is critical for Mobile Network Operators (MNOs), the prospect of performance degradation has prohibited the real-world deployment of RL methods for RET optimization. In this work, we model the RET optimization problem in the Safe Reinforcement Learning (SRL) framework with the goal of learning a tilt control strategy providing performance improvement guarantees with respect to a safe baseline. We leverage a recent SRL method, namely Safe Policy Improvement through Baseline Bootstrapping (SPIBB), to learn an improved policy from an offline dataset of interactions collected by the safe baseline. Our experiments show that the proposed approach is able to learn a safe and improved tilt update policy, providing a higher degree of reliability and potential for real-world network deployment.

📄 PDF Abstract BibTeX arXiv:2010.05842

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement LearningSelf-Learning

A Safe Reinforcement Learning Architecture for Antenna Tilt Optimisation

2020-12-02 · Erik Aumayr, Saman Feghhi, Filippo Vannella, Ezeddin Al Hakim 외

Safe interaction with the environment is one of the most challenging aspects of Reinforcement Learning (RL) when applied to real-world problems. This is particularly important when unsafe actions have a high or irreversi…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Safe RAN control: A Symbolic Reinforcement Learning Approach

2021-06-03 · Alexandros Nikou, Anusha Mujumdar, Vaishnavi Sundararajan, Marin Orlic 외

In this paper, we present a Symbolic Reinforcement Learning (SRL) based architecture for safety control of Radio Access Network (RAN) applications. In particular, we provide a purely automated procedure in which a user c…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Self-Learning

Off-policy Learning for Remote Electrical Tilt Optimization

2020-05-21 · Filippo Vannella, Jaeseong Jeong, Alexandre Proutiere

We address the problem of Remote Electrical Tilt (RET) optimization using off-policy Contextual Multi-Armed-Bandit (CMAB) techniques. The goal in RET optimization is to control the orientation of the vertical tilt angle …

Learning Optimal Antenna Tilt Control Policies: A Contextual Linear Bandit Approach

2022-01-06 · Filippo Vannella, Alexandre Proutiere, Yassir Jedra, Jaeseong Jeong

Controlling antenna tilts in cellular networks is imperative to reach an efficient trade-off between network coverage and capacity. In this paper, we devise algorithms learning optimal tilt control policies from existing…

Active Learning

Tilted Quantile Gradient Updates for Quantile-Constrained Reinforcement Learning

2024-12-17 · Chenglin Li, Guangchun Ruan, Hua Geng

Safe reinforcement learning (RL) is a popular and versatile paradigm to learn reward-maximizing policies with safety guarantees. Previous works tend to express the safety constraints in an expectation form due to the eas…

Form reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1