paper-with-me

Papers

LiRCDepth: Lightweight Radar-Camera Depth Estimation via Knowledge Distillation and Uncertainty Guidance

2024-12-20 · Huawei Sun, Nastassia Vysotskaya, Tobias Sukianto, Hao Feng, Julius Ott, Xiangyuan Peng, Lorenzo Servadei, Robert Wille

Recently, radar-camera fusion algorithms have gained significant attention as radar sensors provide geometric information that complements the limitations of cameras. However, most existing radar-camera depth estimation algorithms focus solely on improving performance, often neglecting computational efficiency. To address this gap, we propose LiRCDepth, a lightweight radar-camera depth estimation model. We incorporate knowledge distillation to enhance the training process, transferring critical information from a complex teacher model to our lightweight student model in three key domains. Firstly, low-level and high-level features are transferred by incorporating pixel-wise and pair-wise distillation. Additionally, we introduce an uncertainty-aware inter-depth distillation loss to refine intermediate depth maps during decoding. Leveraging our proposed knowledge distillation scheme, the lightweight model achieves a 6.6% improvement in MAE on the nuScenes dataset compared to the model trained without distillation. Code: https://github.com/harborsarah/LiRCDepth

📄 PDF Abstract BibTeX arXiv:2412.16380

Code (1)

harborsarah/lircdepth 공식 구현 pytorch

Tasks

Computational EfficiencyDepth EstimationKnowledge Distillation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…
MAE 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

XD-RCDepth: Lightweight Radar-Camera Depth Estimation with Explainability-Aligned and Distribution-Aware Distillation

2025-10-15 · Huawei Sun, Zixu Wang, Xiangyuan Peng, Julius Ott 외 arxiv

Depth estimation remains central to autonomous driving, and radar-camera fusion offers robustness in adverse conditions by providing complementary geometric cues. In this paper, we present XD-RCDepth, a lightweight archi…

Autonomous DrivingDepth Estimation

RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale

2024-01-09 · Han Li, Yukai Ma, Yaqing Gu, Kewei Hu 외

We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings,…

Depth EstimationDepth Prediction

TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusion

2025-04-16 · CVPR 2025 1 · Yiran Wang, Jiaqi Li, Chaoyi Hong, Ruibo Li 외

Radar-Camera depth estimation aims to predict dense and accurate metric depth by fusing input images and Radar data. Model efficiency is crucial for this task in pursuit of real-time processing on autonomous vehicles and…

Autonomous VehiclesDepth Estimation

CaFNet: A Confidence-Driven Framework for Radar Camera Depth Estimation

2024-06-30 · Huawei Sun, Hao Feng, Julius Ott, Lorenzo Servadei 외

Depth estimation is critical in autonomous driving for interpreting 3D scenes accurately. Recently, radar-camera depth estimation has become of sufficient interest due to the robustness and low-cost properties of radar. …

Autonomous DrivingDepth Estimation

Instance-Guided Radar Depth Estimation for 3D Object Detection

2026-01-27 · Chen-Chou Lo, Patrick Vandewalle arxiv

Accurate depth estimation is fundamental to 3D perception in autonomous driving, supporting tasks such as detection, tracking, and motion planning. However, monocular camera-based 3D detection suffers from depth ambiguit…

Monocular 3D Object DetectionInstance SegmentationAutonomous DrivingDepth Estimation