Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Prediction
Millimeter wave (mmWave) and terahertz (THz) drones have the potential to enable several futuristic applications such as coverage extension, enhanced security monitoring, and disaster management. However, these drones need to deploy large antenna arrays and use narrow directive beams to maintain a sufficient link budget. The large beam training overhead associated with these arrays makes adjusting these narrow beams challenging for highly-mobile drones. To address these challenges, this paper proposes a vision-aided machine learning-based approach that leverages visual data collected from cameras installed on the drones to enable fast and accurate beam prediction. Further, to facilitate the evaluation of the proposed solution, we build a synthetic drone communication dataset consisting of co-existing wireless and visual data. The proposed vision-aided solution achieves a top-$1$ beam prediction accuracy of $\approx 91\%$ and close to $100\%$ top-$3$ accuracy. These results highlight the efficacy of the proposed solution towards enabling highly mobile mmWave/THz drone communication.
Code (0)
등록된 구현이 없습니다.
Tasks
Beam PredictionManagementSimilar Papers 제목 키워드 기반
HDNet: Hierarchical Dynamic Network for Gait Recognition using Millimeter-Wave Radar
Gait recognition is widely used in diversified practical applications. Currently, the most prevalent approach is to recognize human gait from RGB images, owing to the progress of computer vision technologies. Nevertheles…
Gait RecognitionCubeDN: Real-time Drone Detection in 3D Space from Dual mmWave Radar Cubes
As drone use has become more widespread, there is a critical need to ensure safety and security. A key element of this is robust and accurate drone detection and localization. While cameras and other optical sensors like…
Object DetectionCameras Viewing Cameras Geometry
A basic problem in computer vision is to understand the structure of a real-world scene given several images of it. Here we study several theoretical aspects of the intra multi-view geometry of calibrated cameras when al…
Autonomous VehiclesComputer Vision Aided Beam Tracking in A Real-World Millimeter Wave Deployment
Millimeter-wave (mmWave) and terahertz (THz) communications require beamforming to acquire adequate receive signal-to-noise ratio (SNR). To find the optimal beam, current beam management solutions perform beam training o…
DecoderManagementRIS-Augmented Millimeter-Wave MIMO Systems for Passive Drone Detection
In the past decade, the number of amateur drones is increasing, and this trend is expected to continue in the future. The security issues brought by abuse and misconduct of drones become more and more severe and may incu…