paper-with-me

홈 › Papers

EfficientLPS: Efficient LiDAR Panoptic Segmentation

2021-02-16 · Kshitij Sirohi, Rohit Mohan, Daniel Büscher, Wolfram Burgard, Abhinav Valada

Panoptic segmentation of point clouds is a crucial task that enables autonomous vehicles to comprehend their vicinity using their highly accurate and reliable LiDAR sensors. Existing top-down approaches tackle this problem by either combining independent task-specific networks or translating methods from the image domain ignoring the intricacies of LiDAR data and thus often resulting in sub-optimal performance. In this paper, we present the novel top-down Efficient LiDAR Panoptic Segmentation (EfficientLPS) architecture that addresses multiple challenges in segmenting LiDAR point clouds including distance-dependent sparsity, severe occlusions, large scale-variations, and re-projection errors. EfficientLPS comprises of a novel shared backbone that encodes with strengthened geometric transformation modeling capacity and aggregates semantically rich range-aware multi-scale features. It incorporates new scale-invariant semantic and instance segmentation heads along with the panoptic fusion module which is supervised by our proposed panoptic periphery loss function. Additionally, we formulate a regularized pseudo labeling framework to further improve the performance of EfficientLPS by training on unlabelled data. We benchmark our proposed model on two large-scale LiDAR datasets: nuScenes, for which we also provide ground truth annotations, and SemanticKITTI. Notably, EfficientLPS sets the new state-of-the-art on both these datasets.

📄 PDF Abstract BibTeX arXiv:2102.08009

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesInstance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

7th AI Driving Olympics: 1st Place Report for Panoptic Tracking

2021-12-09 · Rohit Mohan, Abhinav Valada

In this technical report, we describe our EfficientLPT architecture that won the panoptic tracking challenge in the 7th AI Driving Olympics at NeurIPS 2021. Our architecture builds upon the top-down EfficientLPS panoptic…

BenchmarkingPanoptic SegmentationPanoptic Tracking

Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation

2021-03-27 · CVPR 2021 1 · Zixiang Zhou, Yang Zhang, Hassan Foroosh

Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an effi…

ClusteringInstance SegmentationPanoptic SegmentationSegmentation+1

LidarMultiNet: Unifying LiDAR Semantic Segmentation, 3D Object Detection, and Panoptic Segmentation in a Single Multi-task Network

2022-06-23 · Dongqiangzi Ye, Weijia Chen, Zixiang Zhou, Yufei Xie 외

This technical report presents the 1st place winning solution for the Waymo Open Dataset 3D semantic segmentation challenge 2022. Our network, termed LidarMultiNet, unifies the major LiDAR perception tasks such as 3D sem…

3D Object Detection3D Semantic SegmentationDecoderLIDAR Semantic Segmentation+5

Label-Efficient LiDAR Panoptic Segmentation

2025-03-04 · Ahmet Selim Çanakçı, Niclas Vödisch, Kürsat Petek, Wolfram Burgard 외

A main bottleneck of learning-based robotic scene understanding methods is the heavy reliance on extensive annotated training data, which often limits their generalization ability. In LiDAR panoptic segmentation, this ch…

Instance SegmentationPanoptic SegmentationScene UnderstandingSegmentation+1

LiDAR-Camera Fusion for Video Panoptic Segmentation without Video Training

2024-12-30 · Fardin Ayar, Ehsan Javanmardi, Manabu Tsukada, Mahdi Javanmardi 외

Panoptic segmentation, which combines instance and semantic segmentation, has gained a lot of attention in autonomous vehicles, due to its comprehensive representation of the scene. This task can be applied for cameras a…

Autonomous VehiclesPanoptic SegmentationSegmentationSemantic Segmentation+1