MaskPlus: Improving Mask Generation for Instance Segmentation

2019-07-15 · Shichao Xu, Shuyue Lan, Qi Zhu

Instance segmentation is a promising yet challenging topic in computer vision. Recent approaches such as Mask R-CNN typically divide this problem into two parts -- a detection component and a mask generation branch, and mostly focus on the improvement of the detection part. In this paper, we present an approach that extends Mask R-CNN with five novel optimization techniques for improving the mask generation branch and reducing the conflicts between the mask branch and the detection component in training. These five techniques are independent to each other and can be flexibly utilized in building various instance segmentation architectures for increasing the overall accuracy. We demonstrate the effectiveness of our approach with tests on the COCO dataset.

📄 PDF Abstract BibTeX arXiv:1907.06713

Code (0)

등록된 구현이 없습니다.

Tasks

Instance Segmentation Segmentation Semantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

CenterMask: single shot instance segmentation with point representation

2020-04-09 · CVPR 2020 6 · Yuqing Wang, Zhaoliang Xu, Hao Shen, Baoshan Cheng 외

In this paper, we propose a single-shot instance segmentation method, which is simple, fast and accurate. There are two main challenges for one-stage instance segmentation: object instances differentiation and pixel-wise…

Instance Segmentation Object Segmentation Semantic Segmentation

SegGen: Supercharging Segmentation Models with Text2Mask and Mask2Img Synthesis

2023-11-06 · Hanrong Ye, Jason Kuen, Qing Liu, Zhe Lin 외

We propose SegGen, a highly-effective training data generation method for image segmentation, which pushes the performance limits of state-of-the-art segmentation models to a significant extent. SegGen designs and integr…

Diversity Image Generation Image Segmentation Instance Segmentation+3

Boundary-aware Instance Segmentation

2016-12-09 · CVPR 2017 7 · Zeeshan Hayder, Xuming He, Mathieu Salzmann

We address the problem of instance-level semantic segmentation, which aims at jointly detecting, segmenting and classifying every individual object in an image. In this context, existing methods typically propose candida…

Instance Segmentation Object Object Proposal Generation Segmentation+1

Gen-n-Val: Agentic Image Data Generation and Validation

2025-06-05 · Jing-En Huang, I-Sheng Fang, Tzuhsuan Huang, Chih-Yu Wang 외

Recently, Large Language Models (LLMs) and Vision Large Language Models (VLLMs) have demonstrated impressive performance as agents across various tasks while data scarcity and label noise remain significant challenges in…

Image Harmonization Instance Segmentation Object object-detection+6

CLIP-VIS: Adapting CLIP for Open-Vocabulary Video Instance Segmentation

2024-03-19 · Wenqi Zhu, Jiale Cao, Jin Xie, Shuangming Yang 외

Open-vocabulary video instance segmentation strives to segment and track instances belonging to an open set of categories in a videos. The vision-language model Contrastive Language-Image Pre-training (CLIP) has shown ro…

Decoder Instance Segmentation Language Modelling Segmentation+4