paper-with-me

Papers

Deep Affinity Net: Instance Segmentation via Affinity

2020-03-15 · Xingqian Xu, Mang Tik Chiu, Thomas S. Huang, Honghui Shi

Most of the modern instance segmentation approaches fall into two categories: region-based approaches in which object bounding boxes are detected first and later used in cropping and segmenting instances; and keypoint-based approaches in which individual instances are represented by a set of keypoints followed by a dense pixel clustering around those keypoints. Despite the maturity of these two paradigms, we would like to report an alternative affinity-based paradigm where instances are segmented based on densely predicted affinities and graph partitioning algorithms. Such affinity-based approaches indicate that high-level graph features other than regions or keypoints can be directly applied in the instance segmentation task. In this work, we propose Deep Affinity Net, an effective affinity-based approach accompanied with a new graph partitioning algorithm Cascade-GAEC. Without bells and whistles, our end-to-end model results in 32.4% AP on Cityscapes val and 27.5% AP on test. It achieves the best single-shot result as well as the fastest running time among all affinity-based models. It also outperforms the region-based method Mask R-CNN.

📄 PDF Abstract BibTeX arXiv:2003.06849

Code (0)

등록된 구현이 없습니다.

Tasks

Clusteringgraph partitioningInstance SegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

AsyInst: Asymmetric Affinity with DepthGrad and Color for Box-Supervised Instance Segmentation

2022-12-07 · Siwei Yang, Longlong Jing, Junfei Xiao, Hang Zhao 외

The weakly supervised instance segmentation is a challenging task. The existing methods typically use bounding boxes as supervision and optimize the network with a regularization loss term such as pairwise color affinity…

Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1

Learning Cross-Representation Affinity Consistency for Sparsely Supervised Biomedical Instance Segmentation

2023-01-01 · ICCV 2023 1 · Xiaoyu Liu, Wei Huang, Zhiwei Xiong, Shenglong Zhou 외

Sparse instance-level supervision has recently been explored to address insufficient annotation in biomedical instance segmentation, which is easier to annotate crowded instances and better preserves instance complet…

Instance SegmentationPseudo LabelSemantic Segmentation

MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation

2019-02-12 · Chen Liu, Yasutaka Furukawa

We propose a new approach for 3D instance segmentation based on sparse convolution and point affinity prediction, which indicates the likelihood of two points belonging to the same instance. The proposed network, built u…

3D Instance SegmentationClusteringInstance SegmentationSegmentation+1

Proposal-free Lidar Panoptic Segmentation with Pillar-level Affinity

2022-04-19 · Qi Chen, Sourabh Vora

We propose a simple yet effective proposal-free architecture for lidar panoptic segmentation. We jointly optimize both semantic segmentation and class-agnostic instance classification in a single network using a pillar-b…

ClassificationClusteringobject-detectionObject Detection+3

Label-efficient Segmentation via Affinity Propagation

2023-10-16 · NeurIPS 2023 11 · Wentong Li, Yuqian Yuan, Song Wang, Wenyu Liu 외

Weakly-supervised segmentation with label-efficient sparse annotations has attracted increasing research attention to reduce the cost of laborious pixel-wise labeling process, while the pairwise affinity modeling techniq…

Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1