paper-with-me

Papers

Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detection

2022-11-14 · Yu Hong, Hang Dai, Yong Ding

Leveraging LiDAR-based detectors or real LiDAR point data to guide monocular 3D detection has brought significant improvement, e.g., Pseudo-LiDAR methods. However, the existing methods usually apply non-end-to-end training strategies and insufficiently leverage the LiDAR information, where the rich potential of the LiDAR data has not been well exploited. In this paper, we propose the Cross-Modality Knowledge Distillation (CMKD) network for monocular 3D detection to efficiently and directly transfer the knowledge from LiDAR modality to image modality on both features and responses. Moreover, we further extend CMKD as a semi-supervised training framework by distilling knowledge from large-scale unlabeled data and significantly boost the performance. Until submission, CMKD ranks $1^{st}$ among the monocular 3D detectors with publications on both KITTI $test$ set and Waymo $val$ set with significant performance gains compared to previous state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2211.07171

Code (1)

Cc-Hy/CMKD 공식 구현 pytorch

Tasks

3D Object DetectionKnowledge DistillationMonocular 3D Object Detectionobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Selective Transfer Learning of Cross-Modality Distillation for Monocular 3D Object Detection

2026-03-08 · Rui Ding, Meng Yang, Nanning Zheng arxiv

Monocular 3D object detection is a promising yet ill-posed task for autonomous vehicles due to the lack of accurate depth information. Cross-modality knowledge distillation could effectively transfer depth information fr…

Monocular 3D Object DetectionKnowledge DistillationAutonomous VehiclesTransfer Learning

MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficient

2023-10-17 · Sen Wang, Jin Zheng

Monocular 3D object detection is an inherently ill-posed problem, as it is challenging to predict accurate 3D localization from a single image. Existing monocular 3D detection knowledge distillation methods usually proje…

3D Object DetectionGPUKnowledge DistillationMonocular 3D Object Detection+2

Enhancing Vision-Based Policies with Omni-View and Cross-Modality Knowledge Distillation for Mobile Robots

2026-03-21 · Kai Li, Shiyu Zhao arxiv

Vision-based policies are widely applied in robotics for tasks such as manipulation and locomotion. On lightweight mobile robots, however, they face a trilemma of limited scene transferability, restricted onboard computa…

Knowledge Distillation

ODM3D: Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection

2023-10-28 · Weijia Zhang, Dongnan Liu, Chao Ma, Weidong Cai

Monocular 3D object detection (M3OD) is a significant yet inherently challenging task in autonomous driving due to absence of explicit depth cues in a single RGB image. In this paper, we strive to boost currently underpe…

3D Object DetectionAutonomous DrivingData AugmentationKnowledge Distillation+5

Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection

2022-11-30 · Zizhang Wu, Yunzhe Wu, Jian Pu, Xianzhi Li 외

Monocular 3D object detection is a low-cost but challenging task, as it requires generating accurate 3D localization solely from a single image input. Recent developed depth-assisted methods show promising results by usi…

3D Object DetectionDepth EstimationKnowledge DistillationMonocular 3D Object Detection+4