Off-policy Learning for Remote Electrical Tilt Optimization

2020-05-21 · Filippo Vannella, Jaeseong Jeong, Alexandre Proutiere

We address the problem of Remote Electrical Tilt (RET) optimization using off-policy Contextual Multi-Armed-Bandit (CMAB) techniques. The goal in RET optimization is to control the orientation of the vertical tilt angle of the antenna to optimize Key Performance Indicators (KPIs) representing the Quality of Service (QoS) perceived by the users in cellular networks. Learning an improved tilt update policy is hard. On the one hand, coming up with a new policy in an online manner in a real network requires exploring tilt updates that have never been used before, and is operationally too risky. On the other hand, devising this policy via simulations suffers from the simulation-to-reality gap. In this paper, we circumvent these issues by learning an improved policy in an offline manner using existing data collected on real networks. We formulate the problem of devising such a policy using the off-policy CMAB framework. We propose CMAB learning algorithms to extract optimal tilt update policies from the data. We train and evaluate these policies on real-world 4G Long Term Evolution (LTE) cellular network data. Our policies show consistent improvements over the rule-based logging policy used to collect the data.

📄 PDF Abstract BibTeX arXiv:2005.10577

Code (0)

등록된 구현이 없습니다.

Remote Electrical Tilt Optimization via Safe Reinforcement Learning

2020-10-12 · Filippo Vannella, Grigorios Iakovidis, Ezeddin Al Hakim, Erik Aumayr 외

Remote Electrical Tilt (RET) optimization is an efficient method for adjusting the vertical tilt angle of Base Stations (BSs) antennas in order to optimize Key Performance Indicators (KPIs) of the network. Reinforcement …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning+1

Learning Optimal Antenna Tilt Control Policies: A Contextual Linear Bandit Approach

2022-01-06 · Filippo Vannella, Alexandre Proutiere, Yassir Jedra, Jaeseong Jeong

Controlling antenna tilts in cellular networks is imperative to reach an efficient trade-off between network coverage and capacity. In this paper, we devise algorithms learning optimal tilt control policies from existing…

Active Learning

A Safe Reinforcement Learning Architecture for Antenna Tilt Optimisation

2020-12-02 · Erik Aumayr, Saman Feghhi, Filippo Vannella, Ezeddin Al Hakim 외

Safe interaction with the environment is one of the most challenging aspects of Reinforcement Learning (RL) when applied to real-world problems. This is particularly important when unsafe actions have a high or irreversi…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Safe RAN control: A Symbolic Reinforcement Learning Approach

2021-06-03 · Alexandros Nikou, Anusha Mujumdar, Vaishnavi Sundararajan, Marin Orlic 외

In this paper, we present a Symbolic Reinforcement Learning (SRL) based architecture for safety control of Radio Access Network (RAN) applications. In particular, we provide a purely automated procedure in which a user c…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Self-Learning

Multi-Agent Reinforcement Learning with Common Policy for Antenna Tilt Optimization

2023-02-24 · Adriano Mendo, Jose Outes-Carnero, Yak Ng-Molina, Juan Ramiro-Moreno

This paper presents a method for optimizing wireless networks by adjusting cell parameters that affect both the performance of the cell being optimized and the surrounding cells. The method uses multiple reinforcement le…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)