paper-with-me

홈 › Papers

Joint Object Contour Points and Semantics for Instance Segmentation

2020-08-02 · Wenchao Zhang, Chong Fu, Mai Zhu

The attributes of object contours has great significance for instance segmentation task. However, most of the current popular deep neural networks do not pay much attention to the object edge information. Inspired by the human annotation process when making instance segmentation datasets, in this paper, we propose Mask Point R-CNN aiming at promoting the neural network's attention to the object boundary. Specifically, we innovatively extend the original human keypoint detection task to the contour point detection of any object. Based on this analogy, we present an contour point detection auxiliary task to Mask R-CNN, which can boost the gradient flow between different tasks by effectively using feature fusion strategies and multi-task joint training. As a consequence, the model will be more sensitive to the edges of the object and can capture more geometric features. Quantitatively, the experimental results show that our approach outperforms vanilla Mask R-CNN by 3.8\% on Cityscapes dataset and 0.8\% on COCO dataset.

📄 PDF Abstract BibTeX arXiv:2008.00460

Code (0)

등록된 구현이 없습니다.

Tasks

Instance SegmentationKeypoint DetectionMulti-Task LearningObjectSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Deep Snake for Real-Time Instance Segmentation

2020-01-06 · CVPR 2020 6 · Sida Peng, Wen Jiang, Huaijin Pi, Xiuli Li 외

This paper introduces a novel contour-based approach named deep snake for real-time instance segmentation. Unlike some recent methods that directly regress the coordinates of the object boundary points from an image, dee…

GPUInstance SegmentationObjectObject Localization+3

P2Seg: Pointly-supervised Segmentation via Mutual Distillation

2024-01-18 · Zipeng Wang, Xuehui Yu, Xumeng Han, Wenwen Yu 외

Point-level Supervised Instance Segmentation (PSIS) aims to enhance the applicability and scalability of instance segmentation by utilizing low-cost yet instance-informative annotations. Existing PSIS methods usually rel…

Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+2

Learning Panoptic Segmentation from Instance Contours

2020-10-16 · Sumanth Chennupati, Venkatraman Narayanan, Ganesh Sistu, Senthil Yogamani 외

Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and in…

ClusteringInstance SegmentationPanoptic SegmentationScene Understanding+2

Eigencontours: Novel Contour Descriptors Based on Low-Rank Approximation

2022-03-29 · CVPR 2022 1 · Wonhui Park, Dongkwon Jin, Chang-Su Kim

Novel contour descriptors, called eigencontours, based on low-rank approximation are proposed in this paper. First, we construct a contour matrix containing all object boundaries in a training set. Second, we decompose t…

Instance SegmentationObjectSegmentationSemantic Segmentation

Contour Loss for Instance Segmentation via k-step Distance Transformation Image

2021-02-22 · Xiaolong Guo, Xiaosong Lan, Kunfeng Wang, Shuxiao Li

Instance segmentation aims to locate targets in the image and segment each target area at pixel level, which is one of the most important tasks in computer vision. Mask R-CNN is a classic method of instance segmentation,…

Instance SegmentationSegmentationSemantic Segmentation