Fully Convolutional Networks for Automatically Generating Image Masks to Train Mask R-CNN

2020-03-03 · Hao Wu, Jan Paul Siebert, Xiangrong Xu

This paper proposes a novel automatically generating image masks method for the state-of-the-art Mask R-CNN deep learning method. The Mask R-CNN method achieves the best results in object detection until now, however, it is very time-consuming and laborious to get the object Masks for training, the proposed method is composed by a two-stage design, to automatically generating image masks, the first stage implements a fully convolutional networks (FCN) based segmentation network, the second stage network, a Mask R-CNN based object detection network, which is trained on the object image masks from FCN output, the original input image, and additional label information. Through experimentation, our proposed method can obtain the image masks automatically to train Mask R-CNN, and it can achieve very high classification accuracy with an over 90% mean of average precision (mAP) for segmentation

📄 PDF Abstract BibTeX arXiv:2003.01383

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detection Object Detection Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

FCN Fully Convolutional Networks, or FCNs, are an architecture used mainly for semantic segmentation. They employ solely locally connected layers, such as…

BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation

2015-03-05 · ICCV 2015 12 · Jifeng Dai, Kaiming He, Jian Sun

Recent leading approaches to semantic segmentation rely on deep convolutional networks trained with human-annotated, pixel-level segmentation masks. Such pixel-accurate supervision demands expensive labeling effort and l…

Segmentation Semantic Segmentation

Automatic Generation of Semantic Parts for Face Image Synthesis

2023-07-11 · Tomaso Fontanini, Claudio Ferrari, Massimo Bertozzi, Andrea Prati

Semantic image synthesis (SIS) refers to the problem of generating realistic imagery given a semantic segmentation mask that defines the spatial layout of object classes. Most of the approaches in the literature, other t…

Decoder Image Generation Segmentation Semantic Segmentation

Distantly Supervised Road Segmentation

2017-08-21 · Satoshi Tsutsui, Tommi Kerola, Shunta Saito

We present an approach for road segmentation that only requires image-level annotations at training time. We leverage distant supervision, which allows us to train our model using images that are different from the targe…

Road Segmentation Segmentation

YOLACT: Real-time Instance Segmentation

2019-04-04 · ICCV 2019 10 · Daniel Bolya, Chong Zhou, Fanyi Xiao, Yong Jae Lee

We present a simple, fully-convolutional model for real-time instance segmentation that achieves 29.8 mAP on MS COCO at 33.5 fps evaluated on a single Titan Xp, which is significantly faster than any previous competitive…

GPU Instance Segmentation Real-time Instance Segmentation Segmentation+2

Automatic Weight Estimation of Harvested Fish from Images

2019-09-06 · Dmitry A. Konovalov, Alzayat Saleh, Dina B. Efremova, Jose A. Domingos 외

Approximately 2,500 weights and corresponding images of harvested Lates calcarifer (Asian seabass or barramundi) were collected at three different locations in Queensland, Australia. Two instances of the LinkNet-34 segme…