paper-with-me

홈 › Papers

Learning Inter-Superpoint Affinity for Weakly Supervised 3D Instance Segmentation

2022-10-11 · Linghua Tang, Le Hui, Jin Xie

Due to the few annotated labels of 3D point clouds, how to learn discriminative features of point clouds to segment object instances is a challenging problem. In this paper, we propose a simple yet effective 3D instance segmentation framework that can achieve good performance by annotating only one point for each instance. Specifically, to tackle extremely few labels for instance segmentation, we first oversegment the point cloud into superpoints in an unsupervised manner and extend the point-level annotations to the superpoint level. Then, based on the superpoint graph, we propose an inter-superpoint affinity mining module that considers the semantic and spatial relations to adaptively learn inter-superpoint affinity to generate high-quality pseudo labels via semantic-aware random walk. Finally, we propose a volume-aware instance refinement module to segment high-quality instances by applying volume constraints of objects in clustering on the superpoint graph. Extensive experiments on the ScanNet-v2 and S3DIS datasets demonstrate that our method achieves state-of-the-art performance in the weakly supervised point cloud instance segmentation task, and even outperforms some fully supervised methods.

📄 PDF Abstract BibTeX arXiv:2210.05534

Code (1)

fpthink/3d-wsis 공식 구현 pytorch

Tasks

3D Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

AsyInst: Asymmetric Affinity with DepthGrad and Color for Box-Supervised Instance Segmentation

2022-12-07 · Siwei Yang, Longlong Jing, Junfei Xiao, Hang Zhao 외

The weakly supervised instance segmentation is a challenging task. The existing methods typically use bounding boxes as supervision and optimize the network with a regularization loss term such as pairwise color affinity…

Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1

Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentation

2021-06-08 · Bingfeng Zhang, Jimin Xiao, Jianbo Jiao, Yunchao Wei 외

Weakly supervised semantic segmentation is receiving great attention due to its low human annotation cost. In this paper, we aim to tackle bounding box supervised semantic segmentation, i.e., training accurate semantic s…

Box-supervised Instance SegmentationGraph Neural NetworkInstance SegmentationModel Optimization+4

When 3D Bounding-Box Meets SAM: Point Cloud Instance Segmentation with Weak-and-Noisy Supervision

2023-09-02 · Qingtao Yu, Heming Du, Chen Liu, Xin Yu

Learning from bounding-boxes annotations has shown great potential in weakly-supervised 3D point cloud instance segmentation. However, we observed that existing methods would suffer severe performance degradation with pe…

Instance SegmentationSemantic Segmentation

Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks

2021-08-17 · ICCV 2021 10 · Zhihao Liang, Zhihao LI, Songcen Xu, Mingkui Tan 외

Instance segmentation in 3D scenes is fundamental in many applications of scene understanding. It is yet challenging due to the compound factors of data irregularity and uncertainty in the numbers of instances. State-of-…

3D Instance SegmentationInstance SegmentationScene UnderstandingSemantic Segmentation

Label-efficient Segmentation via Affinity Propagation

2023-10-16 · NeurIPS 2023 11 · Wentong Li, Yuqian Yuan, Song Wang, Wenyu Liu 외

Weakly-supervised segmentation with label-efficient sparse annotations has attracted increasing research attention to reduce the cost of laborious pixel-wise labeling process, while the pairwise affinity modeling techniq…

Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1