paper-with-me

홈 › Papers

Instance-aware Semantic Segmentation via Multi-task Network Cascades

2015-12-14 · CVPR 2016 6 · Jifeng Dai, Kaiming He, Jian Sun

Semantic segmentation research has recently witnessed rapid progress, but many leading methods are unable to identify object instances. In this paper, we present Multi-task Network Cascades for instance-aware semantic segmentation. Our model consists of three networks, respectively differentiating instances, estimating masks, and categorizing objects. These networks form a cascaded structure, and are designed to share their convolutional features. We develop an algorithm for the nontrivial end-to-end training of this causal, cascaded structure. Our solution is a clean, single-step training framework and can be generalized to cascades that have more stages. We demonstrate state-of-the-art instance-aware semantic segmentation accuracy on PASCAL VOC. Meanwhile, our method takes only 360ms testing an image using VGG-16, which is two orders of magnitude faster than previous systems for this challenging problem. As a by product, our method also achieves compelling object detection results which surpass the competitive Fast/Faster R-CNN systems. The method described in this paper is the foundation of our submissions to the MS COCO 2015 segmentation competition, where we won the 1st place.

📄 PDF Abstract BibTeX arXiv:1512.04412

Code (2)

daijifeng001/MNC caffe2
jfc4050/detect-to-track pytorch

Tasks

Multi-Human Parsingobject-detectionObject DetectionSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIWarp Region of Interest Warping, or RoIWarp, is a form of RoIPool that is differentiable with respect to the box position. In…

Similar Papers 제목 키워드 기반

Learning Panoptic Segmentation from Instance Contours

2020-10-16 · Sumanth Chennupati, Venkatraman Narayanan, Ganesh Sistu, Senthil Yogamani 외

Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and in…

ClusteringInstance SegmentationPanoptic SegmentationScene Understanding+2

Instance-aware 3D Semantic Segmentation powered by Shape Generators and Classifiers

2023-11-21 · Bo Sun, QiXing Huang, Xiangru Huang

Existing 3D semantic segmentation methods rely on point-wise or voxel-wise feature descriptors to output segmentation predictions. However, these descriptors are often supervised at point or voxel level, leading to segme…

3D Semantic SegmentationSegmentationSemantic Segmentation

Fully Convolutional Instance-aware Semantic Segmentation

2016-11-23 · CVPR 2017 7 · Yi Li, Haozhi Qi, Jifeng Dai, Xiangyang Ji 외

We present the first fully convolutional end-to-end solution for instance-aware semantic segmentation task. It inherits all the merits of FCNs for semantic segmentation and instance mask proposal. It performs instance ma…

General ClassificationInstance SegmentationSegmentationSemantic Segmentation

InstanceCut: from Edges to Instances with MultiCut

2016-11-24 · CVPR 2017 7 · Alexander Kirillov, Evgeny Levinkov, Bjoern Andres, Bogdan Savchynskyy 외

This work addresses the task of instance-aware semantic segmentation. Our key motivation is to design a simple method with a new modelling-paradigm, which therefore has a different trade-off between advantages and disadv…

Edge DetectionSegmentationSemantic Segmentation

PENet: A Joint Panoptic Edge Detection Network

2023-03-15 · Yang Zhou, Giuseppe Loianno

In recent years, compact and efficient scene understanding representations have gained popularity in increasing situational awareness and autonomy of robotic systems. In this work, we illustrate the concept of a panoptic…

Edge DetectionMulti-Task LearningScene UnderstandingSegmentation