Label-efficient Segmentation via Affinity Propagation
Weakly-supervised segmentation with label-efficient sparse annotations has attracted increasing research attention to reduce the cost of laborious pixel-wise labeling process, while the pairwise affinity modeling techniques play an essential role in this task. Most of the existing approaches focus on using the local appearance kernel to model the neighboring pairwise potentials. However, such a local operation fails to capture the long-range dependencies and ignores the topology of objects. In this work, we formulate the affinity modeling as an affinity propagation process, and propose a local and a global pairwise affinity terms to generate accurate soft pseudo labels. An efficient algorithm is also developed to reduce significantly the computational cost. The proposed approach can be conveniently plugged into existing segmentation networks. Experiments on three typical label-efficient segmentation tasks, i.e. box-supervised instance segmentation, point/scribble-supervised semantic segmentation and CLIP-guided semantic segmentation, demonstrate the superior performance of the proposed approach.
Code (1)
Tasks
Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationWeakly supervised segmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Weak-shot Semantic Segmentation by Transferring Semantic Affinity and Boundary
Weakly-supervised semantic segmentation (WSSS) with image-level labels has been widely studied to relieve the annotation burden of the traditional segmentation task. In this paper, we show that existing fully-annotated b…
SegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationSPARK: Stochastic Propagation via Affinity-guided Random walK for training-free unsupervised segmentation
We argue that existing training-free segmentation methods rely on an implicit and limiting assumption, that segmentation is a spectral graph partitioning problem over diffusion-derived affinities. Such approaches, based …
Semantic Segmentationgraph partitioningLearning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation
The deficiency of segmentation labels is one of the main obstacles to semantic segmentation in the wild. To alleviate this issue, we present a novel framework that generates segmentation labels of images given their imag…
SegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationExploring Scene Affinity for Semi-Supervised LiDAR Semantic Segmentation
This paper explores scene affinity (AIScene), namely intra-scene consistency and inter-scene correlation, for semi-supervised LiDAR semantic segmentation in driving scenes. Adopting teacher-student training, AIScene empl…
3D Semantic SegmentationData AugmentationLIDAR Semantic SegmentationScene Understanding+2Learning Affinity via Spatial Propagation Networks
In this paper, we propose spatial propagation networks for learning the affinity matrix for vision tasks. We show that by constructing a row/column linear propagation model, the spatially varying transformation matrix ex…
ColorizationFace ParsingImage MattingImage Segmentation+2