Deep Affinity Net: Instance Segmentation via Affinity
Most of the modern instance segmentation approaches fall into two categories: region-based approaches in which object bounding boxes are detected first and later used in cropping and segmenting instances; and keypoint-based approaches in which individual instances are represented by a set of keypoints followed by a dense pixel clustering around those keypoints. Despite the maturity of these two paradigms, we would like to report an alternative affinity-based paradigm where instances are segmented based on densely predicted affinities and graph partitioning algorithms. Such affinity-based approaches indicate that high-level graph features other than regions or keypoints can be directly applied in the instance segmentation task. In this work, we propose Deep Affinity Net, an effective affinity-based approach accompanied with a new graph partitioning algorithm Cascade-GAEC. Without bells and whistles, our end-to-end model results in 32.4% AP on Cityscapes val and 27.5% AP on test. It achieves the best single-shot result as well as the fastest running time among all affinity-based models. It also outperforms the region-based method Mask R-CNN.
Code (0)
등록된 구현이 없습니다.
Tasks
Clusteringgraph partitioningInstance SegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AsyInst: Asymmetric Affinity with DepthGrad and Color for Box-Supervised Instance Segmentation
The weakly supervised instance segmentation is a challenging task. The existing methods typically use bounding boxes as supervision and optimize the network with a regularization loss term such as pairwise color affinity…
Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1Learning Cross-Representation Affinity Consistency for Sparsely Supervised Biomedical Instance Segmentation
Sparse instance-level supervision has recently been explored to address insufficient annotation in biomedical instance segmentation, which is easier to annotate crowded instances and better preserves instance complet…
Instance SegmentationPseudo LabelSemantic SegmentationMASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation
We propose a new approach for 3D instance segmentation based on sparse convolution and point affinity prediction, which indicates the likelihood of two points belonging to the same instance. The proposed network, built u…
3D Instance SegmentationClusteringInstance SegmentationSegmentation+1Proposal-free Lidar Panoptic Segmentation with Pillar-level Affinity
We propose a simple yet effective proposal-free architecture for lidar panoptic segmentation. We jointly optimize both semantic segmentation and class-agnostic instance classification in a single network using a pillar-b…
ClassificationClusteringobject-detectionObject Detection+3Label-efficient Segmentation via Affinity Propagation
Weakly-supervised segmentation with label-efficient sparse annotations has attracted increasing research attention to reduce the cost of laborious pixel-wise labeling process, while the pairwise affinity modeling techniq…
Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1