Enhanced Radar Perception via Multi-Task Learning: Towards Refined Data for Sensor Fusion Applications
Radar and camera fusion yields robustness in perception tasks by leveraging the strength of both sensors. The typical extracted radar point cloud is 2D without height information due to insufficient antennas along the elevation axis, which challenges the network performance. This work introduces a learning-based approach to infer the height of radar points associated with 3D objects. A novel robust regression loss is introduced to address the sparse target challenge. In addition, a multi-task training strategy is employed, emphasizing important features. The average radar absolute height error decreases from 1.69 to 0.25 meters compared to the state-of-the-art height extension method. The estimated target height values are used to preprocess and enrich radar data for downstream perception tasks. Integrating this refined radar information further enhances the performance of existing radar camera fusion models for object detection and depth estimation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationMulti-Task Learningobject-detectionObject DetectionSensor FusionSimilar Papers 제목 키워드 기반
CoVeRaP: Cooperative Vehicular Perception through mmWave FMCW Radars
Automotive FMCW radars remain reliable in rain and glare, yet their sparse, noisy point clouds constrain 3-D object detection. We therefore release CoVeRaP, a 21 k-frame cooperative dataset that time-aligns radar, camera…
Object DetectionPoint CloudsEnhanced Automotive Radar Collaborative Sensing By Exploiting Constructive Interference
Automotive radar emerges as a crucial sensor for autonomous vehicle perception. As more cars are equipped radars, radar interference is an unavoidable challenge. Unlike conventional approaches such as interference mitiga…
object-detectionObject DetectionPeakConv: Learning Peak Receptive Field for Radar Semantic Segmentation
The modern machine learning-based technologies have shown considerable potential in automatic radar scene understanding. Among these efforts, radar semantic segmentation (RSS) can provide more refined and detailed in…
ObjectScene UnderstandingSemantic SegmentationWaveC2R: Wavelet-Driven Coarse-to-Refined Hierarchical Learning for Radar Retrieval
Satellite-based radar retrieval methods are widely employed to fill coverage gaps in ground-based radar systems, especially in remote areas affected by terrain blockage and limited detection range. Existing methods predo…
RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Network
Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehe…
3D Multi-Object Tracking3D Object DetectionAutonomous DrivingMulti-Object Tracking+5