paper-with-me

홈 › Papers

A Graph Attention Learning Approach to Antenna Tilt Optimization

2021-12-27 · Yifei Jin, Filippo Vannella, Maxime Bouton, Jaeseong Jeong, Ezeddin Al Hakim

6G will move mobile networks towards increasing levels of complexity. To deal with this complexity, optimization of network parameters is key to ensure high performance and timely adaptivity to dynamic network environments. The optimization of the antenna tilt provides a practical and cost-efficient method to improve coverage and capacity in the network. Previous methods based on Reinforcement Learning (RL) have shown great promise for tilt optimization by learning adaptive policies outperforming traditional tilt optimization methods. However, most existing RL methods are based on single-cell features representation, which fails to fully characterize the agent state, resulting in suboptimal performance. Also, most of such methods lack scalability, due to state-action explosion, and generalization ability. In this paper, we propose a Graph Attention Q-learning (GAQ) algorithm for tilt optimization. GAQ relies on a graph attention mechanism to select relevant neighbors information, improve the agent state representation, and update the tilt control policy based on a history of observations using a Deep Q-Network (DQN). We show that GAQ efficiently captures important network information and outperforms standard DQN with local information by a large margin. In addition, we demonstrate its ability to generalize to network deployments of different sizes and densities.

📄 PDF Abstract BibTeX arXiv:2112.14843

Code (0)

등록된 구현이 없습니다.

Tasks

Graph AttentionQ-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Base Station Antenna Uptilt Optimization for Cellular-Connected Drone Corridors

2021-07-02 · Sung Joon Maeng, Md Moin Uddin Chowdhury, İsmail Güvenç, Arupjyoti Bhuyan 외

The concept of drone corridors is recently getting more attention to enable connected, safe, and secure flight zones in the national airspace. To support beyond visual line of sight (BVLOS) operations of aerial vehicles …

Ensuring Reliable Connectivity to Cellular-Connected UAVs with Up-tilted Antennas and Interference Coordination

2021-08-11 · Md Moin Uddin Chowdhury, Ismail Guvenc, Walid Saad, Arupjyoti Bhuyan

To integrate unmanned aerial vehicles (UAVs) in future large-scale deployments, a new wireless communication paradigm, namely, the cellular-connected UAV has recently attracted interest. However, the line-of-sight domina…

Multi-agent Reinforcement Learning with Graph Q-Networks for Antenna Tuning

2023-01-20 · Maxime Bouton, Jaeseong Jeong, Jose Outes, Adriano Mendo 외

Future generations of mobile networks are expected to contain more and more antennas with growing complexity and more parameters. Optimizing these parameters is necessary for ensuring the good performance of the network.…

Graph Neural NetworkMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning+1

Learning Optimal Antenna Tilt Control Policies: A Contextual Linear Bandit Approach

2022-01-06 · Filippo Vannella, Alexandre Proutiere, Yassir Jedra, Jaeseong Jeong

Controlling antenna tilts in cellular networks is imperative to reach an efficient trade-off between network coverage and capacity. In this paper, we devise algorithms learning optimal tilt control policies from existing…

Active Learning

Non-Terrestrial Networks for UAVs: Base Station Service Provisioning Schemes with Antenna Tilt

2021-04-14 · Seongjun Kim, Minsu Kim, Jong Yeol Ryu, Jemin Lee 외

By focusing on unmanned aerial vehicle (UAV) communications in non-terrestrial networks (NTNs), this paper provides a guideline on the appropriate base station (BS) service provisioning scheme with considering the antenn…