Multi-agent Reinforcement Learning with Graph Q-Networks for Antenna Tuning

2023-01-20 · Maxime Bouton, Jaeseong Jeong, Jose Outes, Adriano Mendo, Alexandros Nikou

Future generations of mobile networks are expected to contain more and more antennas with growing complexity and more parameters. Optimizing these parameters is necessary for ensuring the good performance of the network. The scale of mobile networks makes it challenging to optimize antenna parameters using manual intervention or hand-engineered strategies. Reinforcement learning is a promising technique to address this challenge but existing methods often use local optimizations to scale to large network deployments. We propose a new multi-agent reinforcement learning algorithm to optimize mobile network configurations globally. By using a value decomposition approach, our algorithm can be trained from a global reward function instead of relying on an ad-hoc decomposition of the network performance across the different cells. The algorithm uses a graph neural network architecture which generalizes to different network topologies and learns coordination behaviors. We empirically demonstrate the performance of the algorithm on an antenna tilt tuning problem and a joint tilt and power control problem in a simulated environment.

📄 PDF Abstract BibTeX arXiv:2302.01199

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Online Antenna Tuning in Heterogeneous Cellular Networks with Deep Reinforcement Learning

2019-03-15 · Eren Balevi, Jeffrey G. Andrews

We aim to jointly optimize antenna tilt angle, and vertical and horizontal half-power beamwidths of the macrocells in a heterogeneous cellular network (HetNet). The interactions between the cells, most notably due to the…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

Coordinated Reinforcement Learning for Optimizing Mobile Networks

2021-09-30 · Maxime Bouton, Hasan Farooq, Julien Forgeat, Shruti Bothe 외

Mobile networks are composed of many base stations and for each of them many parameters must be optimized to provide good services. Automatically and dynamically optimizing all these entities is challenging as they are s…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Integrated Graphene Patch Antenna for Communications at THz Frequencies

2022-10-11 · E. P. de Santana, A. K. Wigger, Z. Wang, K. Wang 외

Graphene is an attractive material for communications in the THz range due to its ability to support surface plasmon polaritons. This enables a graphene antenna to be smaller in size than its metallic counterpart. In add…

A Safe Reinforcement Learning Architecture for Antenna Tilt Optimisation

2020-12-02 · Erik Aumayr, Saman Feghhi, Filippo Vannella, Ezeddin Al Hakim 외

Safe interaction with the environment is one of the most challenging aspects of Reinforcement Learning (RL) when applied to real-world problems. This is particularly important when unsafe actions have a high or irreversi…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Low-Altitude Fluid Antenna Network with Multi-Agent Reinforcement Learning

2026-08-28 · Tong Zhang, Yanfei Su, Shuai Wang, Wanli Ni 외 arxiv

Low-altitude wireless networks (LAWNs) integrate terrestrial and aerial platforms to provide ubiquitous communication, sensing, and localization services for unmanned aerial vehicles (UAVs) and electric vertical takeoff …

Multi-agent Reinforcement Learning Transfer Learning