Multi-Agent Double Deep Q-Learning for Beamforming in mmWave MIMO Networks
Beamforming is one of the key techniques in millimeter wave (mmWave) multi-input multi-output (MIMO) communications. Designing appropriate beamforming not only improves the quality and strength of the received signal, but also can help reduce the interference, consequently enhancing the data rate. In this paper, we propose a distributed multi-agent double deep Q-learning algorithm for beamforming in mmWave MIMO networks, where multiple base stations (BSs) can automatically and dynamically adjust their beams to serve multiple highly-mobile user equipments (UEs). In the analysis, largest received power association criterion is considered for UEs, and a realistic channel model is taken into account. Simulation results demonstrate that the proposed learning-based algorithm can achieve comparable performance with respect to exhaustive search while operating at much lower complexity.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
User Association and Hybrid Beamforming Designs for Cooperative mmWave MIMO Systems
Hybrid analog and digital beamforming has emerged as a key enabling technology for millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) communication systems since it can balance the trade-off between s…
CPUClosed-Form Hybrid Beamforming Solution for Spectral Efficiency Upper Bound Maximization in mmWave MIMO-OFDM Systems
Hybrid beamforming is considered a key enabler to realize millimeter wave (mmWave) multiple-input multiple-output (MIMO) communications due to its capability of considerably reducing the number of costly and power-hungry…
FormHybrid Beamforming for Intelligent Reflecting Surface Aided Millimeter Wave MIMO Systems
As communication systems that employ millimeter wave (mmWave) frequency bands must use large antenna arrays to overcome the severe propagation loss of mmWave signals, hybrid beamforming has been considered as an integral…
Deep Learning for Hybrid Beamforming with Finite Feedback in GSM Aided mmWave MIMO Systems
Hybrid beamforming is widely recognized as an important technique for millimeter wave (mmWave) multiple input multiple output (MIMO) systems. Generalized spatial modulation (GSM) is further introduced to improve the spec…
Beamforming Design Via GNN in mmWave Cell-Free Massive MIMO Using Sub-6 GHz CSI
Beamforming methods in millimeter-wave (mmWave) cell-free massive multiple-input multiple-output (CFmMIMO) systems require accurate channel state information (CSI), whose acquisition entails significant training overhead…
Graph Neural Network