Towards accurate instance segmentation in large-scale LiDAR point clouds
Panoptic segmentation is the combination of semantic and instance segmentation: assign the points in a 3D point cloud to semantic categories and partition them into distinct object instances. It has many obvious applications for outdoor scene understanding, from city mapping to forest management. Existing methods struggle to segment nearby instances of the same semantic category, like adjacent pieces of street furniture or neighbouring trees, which limits their usability for inventory- or management-type applications that rely on object instances. This study explores the steps of the panoptic segmentation pipeline concerned with clustering points into object instances, with the goal to alleviate that bottleneck. We find that a carefully designed clustering strategy, which leverages multiple types of learned point embeddings, significantly improves instance segmentation. Experiments on the NPM3D urban mobile mapping dataset and the FOR-instance forest dataset demonstrate the effectiveness and versatility of the proposed strategy.
Code (1)
Tasks
ClusteringInstance SegmentationManagementObjectPanoptic SegmentationScene UnderstandingSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
CPSeg: Cluster-free Panoptic Segmentation of 3D LiDAR Point Clouds
A fast and accurate panoptic segmentation system for LiDAR point clouds is crucial for autonomous driving vehicles to understand the surrounding objects and scenes. Existing approaches usually rely on proposals or cluste…
Autonomous DrivingClusteringDecoderDepth Completion+4EfficientLPS: Efficient LiDAR Panoptic Segmentation
Panoptic segmentation of point clouds is a crucial task that enables autonomous vehicles to comprehend their vicinity using their highly accurate and reliable LiDAR sensors. Existing top-down approaches tackle this probl…
Autonomous VehiclesInstance SegmentationPanoptic SegmentationSegmentation+1ElC-OIS: Ellipsoidal Clustering for Open-World Instance Segmentation on LiDAR Data
Open-world Instance Segmentation (OIS) is a challenging task that aims to accurately segment every object instance appearing in the current observation, regardless of whether these instances have been labeled in the trai…
Autonomous NavigationClusteringInstance SegmentationOpen-World Instance Segmentation+3A Benchmark for LiDAR-based Panoptic Segmentation based on KITTI
Panoptic segmentation is the recently introduced task that tackles semantic segmentation and instance segmentation jointly. In this paper, we present an extension of SemanticKITTI, which is a large-scale dataset providin…
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationPanoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Tracking
Panoptic scene understanding and tracking of dynamic agents are essential for robots and automated vehicles to navigate in urban environments. As LiDARs provide accurate illumination-independent geometric depictions of t…
BenchmarkingDiversityNavigatePanoptic Segmentation+3