PointInst3D: Segmenting 3D Instances by Points
The current state-of-the-art methods in 3D instance segmentation typically involve a clustering step, despite the tendency towards heuristics, greedy algorithms, and a lack of robustness to the changes in data statistics. In contrast, we propose a fully-convolutional 3D point cloud instance segmentation method that works in a per-point prediction fashion. In doing so it avoids the challenges that clustering-based methods face: introducing dependencies among different tasks of the model. We find the key to its success is assigning a suitable target to each sampled point. Instead of the commonly used static or distance-based assignment strategies, we propose to use an Optimal Transport approach to optimally assign target masks to the sampled points according to the dynamic matching costs. Our approach achieves promising results on both ScanNet and S3DIS benchmarks. The proposed approach removes intertask dependencies and thus represents a simpler and more flexible 3D instance segmentation framework than other competing methods, while achieving improved segmentation accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Instance SegmentationClusteringInstance SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Deep Affinity Net: Instance Segmentation via Affinity
Most of the modern instance segmentation approaches fall into two categories: region-based approaches in which object bounding boxes are detected first and later used in cropping and segmenting instances; and keypoint-ba…
Clusteringgraph partitioningInstance SegmentationSemantic SegmentationAssociatively Segmenting Instances and Semantics in Point Clouds
A 3D point cloud describes the real scene precisely and intuitively.To date how to segment diversified elements in such an informative 3D scene is rarely discussed. In this paper, we first introduce a simple and flexible…
3D Instance Segmentation3D Semantic SegmentationInstance SegmentationSegmentation+1From Local Matches to Global Masks: Template-Guided Instance Detection and Segmentation in Open-World Scenes
Detecting and segmenting novel object instances in open-world environments is a fundamental problem in robotic perception. Given only a small set of template images, a robot must locate and segment a specific object inst…
SA3DIP: Segment Any 3D Instance with Potential 3D Priors
The proliferation of 2D foundation models has sparked research into adapting them for open-world 3D instance segmentation. Recent methods introduce a paradigm that leverages superpoints as geometric primitives and incorp…
3D Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagation
We introduce a method for simultaneously classifying, segmenting and tracking object instances in a video sequence. Our method, named MaskProp, adapts the popular Mask R-CNN to video by adding a mask propagation branch t…
Instance SegmentationObjectSegmentationSemantic Segmentation+1