Joint Object Contour Points and Semantics for Instance Segmentation
The attributes of object contours has great significance for instance segmentation task. However, most of the current popular deep neural networks do not pay much attention to the object edge information. Inspired by the human annotation process when making instance segmentation datasets, in this paper, we propose Mask Point R-CNN aiming at promoting the neural network's attention to the object boundary. Specifically, we innovatively extend the original human keypoint detection task to the contour point detection of any object. Based on this analogy, we present an contour point detection auxiliary task to Mask R-CNN, which can boost the gradient flow between different tasks by effectively using feature fusion strategies and multi-task joint training. As a consequence, the model will be more sensitive to the edges of the object and can capture more geometric features. Quantitatively, the experimental results show that our approach outperforms vanilla Mask R-CNN by 3.8\% on Cityscapes dataset and 0.8\% on COCO dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationKeypoint DetectionMulti-Task LearningObjectSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Snake for Real-Time Instance Segmentation
This paper introduces a novel contour-based approach named deep snake for real-time instance segmentation. Unlike some recent methods that directly regress the coordinates of the object boundary points from an image, dee…
GPUInstance SegmentationObjectObject Localization+3P2Seg: Pointly-supervised Segmentation via Mutual Distillation
Point-level Supervised Instance Segmentation (PSIS) aims to enhance the applicability and scalability of instance segmentation by utilizing low-cost yet instance-informative annotations. Existing PSIS methods usually rel…
Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+2Learning Panoptic Segmentation from Instance Contours
Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and in…
ClusteringInstance SegmentationPanoptic SegmentationScene Understanding+2Eigencontours: Novel Contour Descriptors Based on Low-Rank Approximation
Novel contour descriptors, called eigencontours, based on low-rank approximation are proposed in this paper. First, we construct a contour matrix containing all object boundaries in a training set. Second, we decompose t…
Instance SegmentationObjectSegmentationSemantic SegmentationContour Loss for Instance Segmentation via k-step Distance Transformation Image
Instance segmentation aims to locate targets in the image and segment each target area at pixel level, which is one of the most important tasks in computer vision. Mask R-CNN is a classic method of instance segmentation,…
Instance SegmentationSegmentationSemantic Segmentation