Deep Reinforcement Learning based Blind mmWave MIMO Beam Alignment
Directional beamforming is a crucial component for realizing robust wireless communication systems using millimeter wave (mmWave) technology. Beam alignment using brute-force search of the space introduces time overhead while location aided blind beam alignment adds additional hardware requirements to the system. In this paper, we introduce a method for blind beam alignment based on the RF fingerprints of user equipment obtained by the base stations. The proposed system performs blind beam alignment on a multiple base station cellular environment with multiple mobile users using deep reinforcement learning. We present a novel neural network architecture that can handle a mix of both continuous and discrete actions and use policy gradient methods to train the model. Our results show that the proposed method can achieve a data rate of up to four times the traditional method without any overheads.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningPolicy Gradient Methodsreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Environment-Aware and Training-Free Beam Alignment for mmWave Massive MIMO via Channel Knowledge Map
Millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) communication system is expected to achieve enormous transmission rate, provided that the transmit and receive beams are properly aligned with the MI…
Enhanced Beam Alignment for Millimeter Wave MIMO Systems: A Kolmogorov Model
We present an enhancement to the problem of beam alignment in millimeter wave (mmWave) multiple-input multiple-output (MIMO) systems, based on a modification of the machine learning-based criterion, called Kolmogorov mod…
Two-sample testingInertial Sensor Aided mmWave Beam Tracking to Support Cooperative Autonomous Driving
This paper presents an inertial sensor aided technique for beam alignment and tracking in massive multiple-input multiple-output (MIMO) vehicle-to-vehicle (V2V) communications based on millimeter waves (mmWave). Since di…
Autonomous DrivingBayesian Optimization-Based Beam Alignment for MmWave MIMO Communication Systems
Due to the very narrow beam used in millimeter wave communication (mmWave), beam alignment (BA) is a critical issue. In this work, we investigate the issue of mmWave BA and present a novel beam alignment scheme on the ba…
Bayesian OptimizationThompson SamplingLeveraging Location Information for RIS-aided mmWave MIMO Communications
Location information offered by external positioning systems, e.g., satellite navigation, can be used as prior information in the process of beam alignment and channel parameter estimation for reconfigurable intelligent …
parameter estimation