Fast mmwave Beam Alignment via Correlated Bandit Learning
Beam alignment (BA) is to ensure the transmitter and receiver beams are accurately aligned to establish a reliable communication link in millimeter-wave (mmwave) systems. Existing BA methods search the entire beam space to identify the optimal transmit-receive beam pair, which incurs significant BA latency on the order of seconds in the worst case. In this paper, we develop a learning algorithm to reduce BA latency, namely Hierarchical Beam Alignment (HBA) algorithm. We first formulate the BA problem as a stochastic multi-armed bandit problem with the objective to maximize the cumulative received signal strength within a certain period. The proposed algorithm takes advantage of the correlation structure among beams such that the information from nearby beams is extracted to identify the optimal beam, instead of searching the entire beam space. Furthermore, the prior knowledge on the channel fluctuation is incorporated in the proposed algorithm to further accelerate the BA process. Theoretical analysis indicates that the proposed algorithm is asymptotically optimal. Extensive simulation results demonstrate that the proposed algorithm can identify the optimal beam with a high probability and reduce the BA latency from hundreds of milliseconds to a few milliseconds in the multipath channel, as compared to the existing BA method in IEEE 802.11ad.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DQN-based Beamforming for Uplink mmWave Cellular-Connected UAVs
Unmanned aerial vehicles (UAVs) are the emerging vital components of millimeter wave (mmWave) wireless systems. Accurate beam alignment is essential for efficient beam-based mmWave communications of UAVs with base statio…
Reinforcement Learning (RL)Deep Contextual Bandits for Fast Initial Access in mmWave Based User-Centric Ultra-Dense Networks
Millimeter wave (mmWave) based multiple-input multiple-output (MIMO) capable user-centric (UC) ultra-dense (UD) networks are suggested to facilitate high throughput requirements of future networks. Due to the high blocka…
ManagementMulti-Armed BanditsFast Beam Alignment via Pure Exploration in Multi-armed Bandits
The beam alignment (BA) problem consists in accurately aligning the transmitter and receiver beams to establish a reliable communication link in wireless communication systems. Existing BA methods search the entire beam …
Multi-Armed BanditsPhysics-Informed Parametric Bandits for Beam Alignment in mmWave Communications
In millimeter wave (mmWave) communications, beam alignment and tracking are crucial to combat the significant path loss. As scanning the entire directional space is inefficient, designing an efficient and robust method t…
Bayesian Optimization-Based Beam Alignment for MmWave MIMO Communication Systems
Due to the very narrow beam used in millimeter wave communication (mmWave), beam alignment (BA) is a critical issue. In this work, we investigate the issue of mmWave BA and present a novel beam alignment scheme on the ba…
Bayesian OptimizationThompson Sampling