RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features
The inherent noisy and sparse characteristics of radar data pose challenges in finding effective representations for 3D object detection. In this paper, we propose RadarDistill, a novel knowledge distillation (KD) method, which can improve the representation of radar data by leveraging LiDAR data. RadarDistill successfully transfers desirable characteristics of LiDAR features into radar features using three key components: Cross-Modality Alignment (CMA), Activation-based Feature Distillation (AFD), and Proposal-based Feature Distillation (PFD). CMA enhances the density of radar features by employing multiple layers of dilation operations, effectively addressing the challenge of inefficient knowledge transfer from LiDAR to radar. AFD selectively transfers knowledge based on regions of the LiDAR features, with a specific focus on areas where activation intensity exceeds a predefined threshold. PFD similarly guides the radar network to selectively mimic features from the LiDAR network within the object proposals. Our comparative analyses conducted on the nuScenes datasets demonstrate that RadarDistill achieves state-of-the-art (SOTA) performance for radar-only object detection task, recording 20.5% in mAP and 43.7% in NDS. Also, RadarDistill significantly improves the performance of the camera-radar fusion model.
Code (1)
Tasks
3D Object DetectionKnowledge DistillationObjectobject-detectionObject DetectionTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BoostRad: Enhancing Object Detection by Boosting Radar Reflections
Automotive radars have an important role in autonomous driving systems. The main challenge in automotive radar detection is the radar's wide point spread function (PSF) in the angular domain that causes blurriness and cl…
Autonomous DrivingObjectobject-detectionObject DetectionChannel Boosting Feature Ensemble for Radar-based Object Detection
Autonomous vehicles are conceived to provide safe and secure services by validating the safety standards as indicated by SOTIF-ISO/PAS-21448 (Safety of the intended functionality). Keeping in this context, the perception…
Autonomous VehiclesDecoderObjectobject-detection+1YOdar: Uncertainty-based Sensor Fusion for Vehicle Detection with Camera and Radar Sensors
In this work, we present an uncertainty-based method for sensor fusion with camera and radar data. The outputs of two neural networks, one processing camera and the other one radar data, are combined in an uncertainty aw…
Objectobject-detectionObject DetectionSensor Fusion+1Boosting Instance Awareness via Cross-View Correlation with 4D Radar and Camera for 3D Object Detection
4D millimeter-wave radar has emerged as a promising sensing modality for autonomous driving due to its robustness and affordability. However, its sparse and weak geometric cues make reliable instance activation difficult…
Scene Understanding3D Object DetectionAutonomous DrivingBoosting Online 3D Multi-Object Tracking through Camera-Radar Cross Check
In the domain of autonomous driving, the integration of multi-modal perception techniques based on data from diverse sensors has demonstrated substantial progress. Effectively surpassing the capabilities of state-of-the-…
3D Multi-Object TrackingAutonomous DrivingMulti-Object TrackingObject Tracking+1