SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection
3D object detection is one of the fundamental perception tasks for autonomous vehicles. Fulfilling such a task with a 4D millimeter-wave radar is very attractive since the sensor is able to acquire 3D point clouds similar to Lidar while maintaining robust measurements under adverse weather. However, due to the high sparsity and noise associated with the radar point clouds, the performance of the existing methods is still much lower than expected. In this paper, we propose a novel Semi-supervised Cross-modality Knowledge Distillation (SCKD) method for 4D radar-based 3D object detection. It characterizes the capability of learning the feature from a Lidar-radar-fused teacher network with semi-supervised distillation. We first propose an adaptive fusion module in the teacher network to boost its performance. Then, two feature distillation modules are designed to facilitate the cross-modality knowledge transfer. Finally, a semi-supervised output distillation is proposed to increase the effectiveness and flexibility of the distillation framework. With the same network structure, our radar-only student trained by SCKD boosts the mAP by 10.38% over the baseline and outperforms the state-of-the-art works on the VoD dataset. The experiment on ZJUODset also shows 5.12% mAP improvements on the moderate difficulty level over the baseline when extra unlabeled data are available. Code is available at https://github.com/Ruoyu-Xu/SCKD.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionAutonomous VehiclesKnowledge Distillationobject-detectionObject DetectionRadar Object DetectionTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Asymmetric Cross-Modal Knowledge Distillation: Bridging Modalities with Weak Semantic Consistency
Cross-modal Knowledge Distillation has demonstrated promising performance on paired modalities with strong semantic connections, referred to as Symmetric Cross-modal Knowledge Distillation (SCKD). However, implementing S…
Self-Supervised LearningKnowledge DistillationScene ClassificationscKDGM: KAN-guided Dynamic Graph Masked Learning for Single-Cell RNA-seq Clustering
Single-cell RNA sequencing (scRNA-seq) clustering is essential for identifying cell types, but high dimensionality, sparsity, dropout, and technical noise hinder robust expression representation and cell graph constructi…
Contrastive LearningGraph ClusteringSerial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction
Continual few-shot relation extraction (RE) aims to continuously train a model for new relations with few labeled training data, of which the major challenges are the catastrophic forgetting of old relations and the over…
Contrastive LearningKnowledge DistillationRelationRelation Extraction+1Modality-Specific Enhancement and Complementary Fusion for Semi-Supervised Multi-Modal Brain Tumor Segmentation
Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches fo…
Medical Image SegmentationBrain Tumor SegmentationAudio-visual cross-modality knowledge transfer for machine learning-based in-situ monitoring in laser additive manufacturing
Various machine learning (ML)-based in-situ monitoring systems have been developed to detect anomalies and defects in laser additive manufacturing (LAM) processes. While multimodal fusion, which integrates data from visu…
Anomaly DetectionDefect DetectionExplainable artificial intelligenceTransfer Learning