EfficientLPS: Efficient LiDAR Panoptic Segmentation
Panoptic segmentation of point clouds is a crucial task that enables autonomous vehicles to comprehend their vicinity using their highly accurate and reliable LiDAR sensors. Existing top-down approaches tackle this problem by either combining independent task-specific networks or translating methods from the image domain ignoring the intricacies of LiDAR data and thus often resulting in sub-optimal performance. In this paper, we present the novel top-down Efficient LiDAR Panoptic Segmentation (EfficientLPS) architecture that addresses multiple challenges in segmenting LiDAR point clouds including distance-dependent sparsity, severe occlusions, large scale-variations, and re-projection errors. EfficientLPS comprises of a novel shared backbone that encodes with strengthened geometric transformation modeling capacity and aggregates semantically rich range-aware multi-scale features. It incorporates new scale-invariant semantic and instance segmentation heads along with the panoptic fusion module which is supervised by our proposed panoptic periphery loss function. Additionally, we formulate a regularized pseudo labeling framework to further improve the performance of EfficientLPS by training on unlabelled data. We benchmark our proposed model on two large-scale LiDAR datasets: nuScenes, for which we also provide ground truth annotations, and SemanticKITTI. Notably, EfficientLPS sets the new state-of-the-art on both these datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesInstance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
7th AI Driving Olympics: 1st Place Report for Panoptic Tracking
In this technical report, we describe our EfficientLPT architecture that won the panoptic tracking challenge in the 7th AI Driving Olympics at NeurIPS 2021. Our architecture builds upon the top-down EfficientLPS panoptic…
BenchmarkingPanoptic SegmentationPanoptic TrackingPanoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation
Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an effi…
ClusteringInstance SegmentationPanoptic SegmentationSegmentation+1LidarMultiNet: Unifying LiDAR Semantic Segmentation, 3D Object Detection, and Panoptic Segmentation in a Single Multi-task Network
This technical report presents the 1st place winning solution for the Waymo Open Dataset 3D semantic segmentation challenge 2022. Our network, termed LidarMultiNet, unifies the major LiDAR perception tasks such as 3D sem…
3D Object Detection3D Semantic SegmentationDecoderLIDAR Semantic Segmentation+5Label-Efficient LiDAR Panoptic Segmentation
A main bottleneck of learning-based robotic scene understanding methods is the heavy reliance on extensive annotated training data, which often limits their generalization ability. In LiDAR panoptic segmentation, this ch…
Instance SegmentationPanoptic SegmentationScene UnderstandingSegmentation+1LiDAR-Camera Fusion for Video Panoptic Segmentation without Video Training
Panoptic segmentation, which combines instance and semantic segmentation, has gained a lot of attention in autonomous vehicles, due to its comprehensive representation of the scene. This task can be applied for cameras a…
Autonomous VehiclesPanoptic SegmentationSegmentationSemantic Segmentation+1