paper-with-me

Papers

A novel Region of Interest Extraction Layer for Instance Segmentation

2020-04-28 · Leonardo Rossi, Akbar Karimi, Andrea Prati

Given the wide diffusion of deep neural network architectures for computer vision tasks, several new applications are nowadays more and more feasible. Among them, a particular attention has been recently given to instance segmentation, by exploiting the results achievable by two-stage networks (such as Mask R-CNN or Faster R-CNN), derived from R-CNN. In these complex architectures, a crucial role is played by the Region of Interest (RoI) extraction layer, devoted to extracting a coherent subset of features from a single Feature Pyramid Network (FPN) layer attached on top of a backbone. This paper is motivated by the need to overcome the limitations of existing RoI extractors which select only one (the best) layer from FPN. Our intuition is that all the layers of FPN retain useful information. Therefore, the proposed layer (called Generic RoI Extractor - GRoIE) introduces non-local building blocks and attention mechanisms to boost the performance. A comprehensive ablation study at component level is conducted to find the best set of algorithms and parameters for the GRoIE layer. Moreover, GRoIE can be integrated seamlessly with every two-stage architecture for both object detection and instance segmentation tasks. Therefore, the improvements brought about by the use of GRoIE in different state-of-the-art architectures are also evaluated. The proposed layer leads up to gain a 1.1% AP improvement on bounding box detection and 1.7% AP improvement on instance segmentation. The code is publicly available on GitHub repository at https://github.com/IMPLabUniPr/mmdetection/tree/groie_dev

📄 PDF Abstract BibTeX arXiv:2004.13665

Code (5)

open-mmlab/mmdetection/tree/master/configs/groie 공식 구현 pytorch
Gugan0905/steel-defect-detection pytorch
IMPLabUniPr/mmdetection pytorch
IMPLabUniPr/mmdetection-groie pytorch
open-mmlab/mmdetection pytorch

Tasks

Instance Segmentationobject-detectionObject DetectionSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Non-Local Operation A Non-Local Operation is a component for capturing long-range dependencies with deep neural networks. It is a generalization of the classical non-local mean operation in…
Residual Connection 설명 없음
Non-Local Block A Non-Local Block is an image block module used in neural networks that wraps a non-local operation. We can define a…
GRoIE GroIE is an RoI extractor which intends to overcome the limitation of existing extractors which select only one (the best) layer from the…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
FPN 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Deeply Shape-guided Cascade for Instance Segmentation

2019-11-25 · CVPR 2021 1 · Hao Ding, Siyuan Qiao, Alan Yuille, Wei Shen

The key to a successful cascade architecture for precise instance segmentation is to fully leverage the relationship between bounding box detection and mask segmentation across multiple stages. Although modern instance s…

Instance SegmentationRegion ProposalSegmentationSemantic Segmentation

Self-Balanced R-CNN for Instance Segmentation

2024-04-25 · Leonardo Rossi, Akbar Karimi, Andrea Prati

Current state-of-the-art two-stage models on instance segmentation task suffer from several types of imbalances. In this paper, we address the Intersection over the Union (IoU) distribution imbalance of positive input Re…

Instance Segmentationobject-detectionObject DetectionSemantic Segmentation

Salient Instance Segmentation with Region and Box-level Annotations

2020-08-19 · Jialun Pei, He Tang, Tianyang Cheng, Chuanbo Chen

Salient instance segmentation is a new challenging task that received widespread attention in the saliency detection area. The new generation of saliency detection provides a strong theoretical and technical basis for vi…

Instance Segmentationobject-detectionObject DetectionSaliency Detection+3

A deep learning framework for segmentation of retinal layers from OCT images

2018-06-22 · Karthik Gopinath, Samrudhdhi B Rangrej, Jayanthi Sivaswamy

Segmentation of retinal layers from Optical Coherence Tomography (OCT) volumes is a fundamental problem for any computer aided diagnostic algorithm development. This requires preprocessing steps such as denoising, region…

DenoisingDiagnosticEdge Detection

Learning to Aggregate Multi-Scale Context for Instance Segmentation in Remote Sensing Images

2021-11-22 · Ye Liu, Huifang Li, Chao Hu, Shuang Luo 외

The task of instance segmentation in remote sensing images, aiming at performing per-pixel labeling of objects at instance level, is of great importance for various civil applications. Despite previous successes, most ex…

Instance SegmentationObject Detection