paper-with-me

홈 › Papers

Knowledge Distillation from 3D to Bird's-Eye-View for LiDAR Semantic Segmentation

2023-04-22 · Feng Jiang, Heng Gao, Shoumeng Qiu, Haiqiang Zhang, Ru Wan, Jian Pu

LiDAR point cloud segmentation is one of the most fundamental tasks for autonomous driving scene understanding. However, it is difficult for existing models to achieve both high inference speed and accuracy simultaneously. For example, voxel-based methods perform well in accuracy, while Bird's-Eye-View (BEV)-based methods can achieve real-time inference. To overcome this issue, we develop an effective 3D-to-BEV knowledge distillation method that transfers rich knowledge from 3D voxel-based models to BEV-based models. Our framework mainly consists of two modules: the voxel-to-pillar distillation module and the label-weight distillation module. Voxel-to-pillar distillation distills sparse 3D features to BEV features for middle layers to make the BEV-based model aware of more structural and geometric information. Label-weight distillation helps the model pay more attention to regions with more height information. Finally, we conduct experiments on the SemanticKITTI dataset and Paris-Lille-3D. The results on SemanticKITTI show more than 5% improvement on the test set, especially for classes such as motorcycle and person, with more than 15% improvement. The code can be accessed at https://github.com/fengjiang5/Knowledge-Distillation-from-Cylinder3D-to-PolarNet.

📄 PDF Abstract BibTeX arXiv:2304.11393

Code (1)

fengjiang5/knowledge-distillation-from-cylinder3d-to-polarnet 공식 구현 pytorch

Tasks

Autonomous DrivingKnowledge DistillationLIDAR Semantic SegmentationPoint Cloud SegmentationScene UnderstandingSemantic Segmentation

Methods 이 논문이 사용한 방법론

Test 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

KD360-VoxelBEV: LiDAR and 360-degree Camera Cross Modality Knowledge Distillation for Bird's-Eye-View Segmentation

2025-12-17 · Wenke E, Yixin Sun, Jiaxu Liu, Hubert P. H. Shum 외 arxiv

We present the first cross-modality distillation framework specifically tailored for single-panoramic-camera Bird's-Eye-View (BEV) segmentation. Our approach leverages a novel LiDAR image representation fused from range,…

Knowledge DistillationAutonomous DrivingBEV Segmentation

LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillation

2023-04-22 · CVPR 2023 1 · Song Wang, Wentong Li, Wenyu Liu, Xiaolu Liu 외

Semantic map construction under bird's-eye view (BEV) plays an essential role in autonomous driving. In contrast to camera image, LiDAR provides the accurate 3D observations to project the captured 3D features onto BEV s…

Autonomous DrivingDecoder

UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View

2023-03-27 · CVPR 2023 1 · Shengchao Zhou, Weizhou Liu, Chen Hu, Shuchang Zhou 외

In the field of 3D object detection for autonomous driving, the sensor portfolio including multi-modality and single-modality is diverse and complex. Since the multi-modal methods have system complexity while the accurac…

3D Object DetectionAutonomous DrivingKnowledge Distillationobject-detection+1

HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation

2024-03-18 · Sha Zhang, Jiajun Deng, Lei Bai, Houqiang Li 외

We present a hybrid-view-based knowledge distillation framework, termed HVDistill, to guide the feature learning of a point cloud neural network with a pre-trained image network in an unsupervised man- ner. By exploiting…

Knowledge DistillationNERRepresentation Learning

SDGOCC: Semantic and Depth-Guided Bird's-Eye View Transformation for 3D Multimodal Occupancy Prediction

2025-07-22 · Zaipeng Duan, Chenxu Dang, Xuzhong Hu, Pei An 외 arxiv

Multimodal 3D occupancy prediction has garnered significant attention for its potential in autonomous driving. However, most existing approaches are single-modality: camera-based methods lack depth information, while LiD…

Autonomous DrivingDepth Estimation