paper-with-me

홈 › Papers

RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features

2024-03-08 · CVPR 2024 1 · Geonho Bang, Kwangjin Choi, Jisong Kim, Dongsuk Kum, Jun Won Choi

The inherent noisy and sparse characteristics of radar data pose challenges in finding effective representations for 3D object detection. In this paper, we propose RadarDistill, a novel knowledge distillation (KD) method, which can improve the representation of radar data by leveraging LiDAR data. RadarDistill successfully transfers desirable characteristics of LiDAR features into radar features using three key components: Cross-Modality Alignment (CMA), Activation-based Feature Distillation (AFD), and Proposal-based Feature Distillation (PFD). CMA enhances the density of radar features by employing multiple layers of dilation operations, effectively addressing the challenge of inefficient knowledge transfer from LiDAR to radar. AFD selectively transfers knowledge based on regions of the LiDAR features, with a specific focus on areas where activation intensity exceeds a predefined threshold. PFD similarly guides the radar network to selectively mimic features from the LiDAR network within the object proposals. Our comparative analyses conducted on the nuScenes datasets demonstrate that RadarDistill achieves state-of-the-art (SOTA) performance for radar-only object detection task, recording 20.5% in mAP and 43.7% in NDS. Also, RadarDistill significantly improves the performance of the camera-radar fusion model.

📄 PDF Abstract BibTeX arXiv:2403.05061

Code (1)

geonhobang/RadarDistill 공식 구현 pytorch

Tasks

3D Object DetectionKnowledge DistillationObjectobject-detectionObject DetectionTransfer Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

BoostRad: Enhancing Object Detection by Boosting Radar Reflections

2024-04-27 · Yuval Haitman, Oded Bialer

Automotive radars have an important role in autonomous driving systems. The main challenge in automotive radar detection is the radar's wide point spread function (PSF) in the angular domain that causes blurriness and cl…

Autonomous DrivingObjectobject-detectionObject Detection

Channel Boosting Feature Ensemble for Radar-based Object Detection

2021-01-10 · Shoaib Azam, Farzeen Munir, Moongu Jeon

Autonomous vehicles are conceived to provide safe and secure services by validating the safety standards as indicated by SOTIF-ISO/PAS-21448 (Safety of the intended functionality). Keeping in this context, the perception…

Autonomous VehiclesDecoderObjectobject-detection+1

YOdar: Uncertainty-based Sensor Fusion for Vehicle Detection with Camera and Radar Sensors

2020-10-07 · Kamil Kowol, Matthias Rottmann, Stefan Bracke, Hanno Gottschalk

In this work, we present an uncertainty-based method for sensor fusion with camera and radar data. The outputs of two neural networks, one processing camera and the other one radar data, are combined in an uncertainty aw…

Objectobject-detectionObject DetectionSensor Fusion+1

Boosting Instance Awareness via Cross-View Correlation with 4D Radar and Camera for 3D Object Detection

2026-02-24 · Xiaokai Bai, Lianqing Zheng, Si-Yuan Cao, Xiaohan Zhang 외 arxiv

4D millimeter-wave radar has emerged as a promising sensing modality for autonomous driving due to its robustness and affordability. However, its sparse and weak geometric cues make reliable instance activation difficult…

Scene Understanding3D Object DetectionAutonomous Driving

Boosting Online 3D Multi-Object Tracking through Camera-Radar Cross Check

2024-07-18 · Sheng-Yao Kuan, Jen-Hao Cheng, Hsiang-Wei Huang, Wenhao Chai 외

In the domain of autonomous driving, the integration of multi-modal perception techniques based on data from diverse sensors has demonstrated substantial progress. Effectively surpassing the capabilities of state-of-the-…

3D Multi-Object TrackingAutonomous DrivingMulti-Object TrackingObject Tracking+1