ViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutions
Vision-aided wireless communication is motivated by the recent advances in deep learning and computer vision as well as the increasing dependence on line-of-sight links in millimeter wave (mmWave) and terahertz systems. By leveraging vision, this new research direction enables an interesting set of new capabilities such as vision-aided mmWave beam and blockage prediction, proactive hand-off, and resource allocation among others. These capabilities have the potential of reliably supporting highly-mobile applications such as vehicular/drone communications and wireless virtual/augmented reality in mmWave and terahertz systems. Investigating these interesting applications, however, requires the development of special dataset and machine learning tasks. Based on the Vision-Wireless (ViWi) dataset generation framework [1], this paper develops an advanced and realistic scenario/dataset that features multiple base stations, mobile users, and rich dynamics. Enabled by this dataset, the paper defines the vision-wireless mmWave beam tracking task (ViWi-BT) and proposes a baseline solution that can provide an initial benchmark for the future ViWi-BT algorithms.
Code (1)
Tasks
Dataset GenerationSimilar Papers 제목 키워드 기반
Vision-Aided Beam Tracking: Explore the Proper Use of Camera Images with Deep Learning
We investigate the problem of wireless beam tracking on mmWave bands with the assistance of camera images. In particular, based on the user's beam indices used and camera images taken in the trajectory, we predict the op…
Beam PredictionInertial Sensor Aided mmWave Beam Tracking to Support Cooperative Autonomous Driving
This paper presents an inertial sensor aided technique for beam alignment and tracking in massive multiple-input multiple-output (MIMO) vehicle-to-vehicle (V2V) communications based on millimeter waves (mmWave). Since di…
Autonomous DrivingLiDAR Aided Future Beam Prediction in Real-World Millimeter Wave V2I Communications
This paper presents the first large-scale real-world evaluation for using LiDAR data to guide the mmWave beam prediction task. A machine learning (ML) model that leverages the LiDAR sensory data to predict the current an…
Beam PredictionComputer Vision Aided Beam Tracking in A Real-World Millimeter Wave Deployment
Millimeter-wave (mmWave) and terahertz (THz) communications require beamforming to acquire adequate receive signal-to-noise ratio (SNR). To find the optimal beam, current beam management solutions perform beam training o…
DecoderManagementSuccessive Pose Estimation and Beam Tracking for mmWave Vehicular Communication Systems
The millimeter wave (mmWave) radar sensing-aided communications in vehicular mobile communication systems is investigated. To alleviate the beam training overhead under high mobility scenarios, a successive pose estimati…
Pose EstimationRadar odometry