Weakly Supervised Instance Segmentation by Deep Community Learning

2020-01-30 · Jaedong Hwang, Seohyun Kim, Jeany Son, Bohyung Han

We present a weakly supervised instance segmentation algorithm based on deep community learning with multiple tasks. This task is formulated as a combination of weakly supervised object detection and semantic segmentation, where individual objects of the same class are identified and segmented separately. We address this problem by designing a unified deep neural network architecture, which has a positive feedback loop of object detection with bounding box regression, instance mask generation, instance segmentation, and feature extraction. Each component of the network makes active interactions with others to improve accuracy, and the end-to-end trainability of our model makes our results more robust and reproducible. The proposed algorithm achieves state-of-the-art performance in the weakly supervised setting without any additional training such as Fast R-CNN and Mask R-CNN on the standard benchmark dataset. The implementation of our algorithm is available on the project webpage: https://cv.snu.ac.kr/research/WSIS_CL.

📄 PDF Abstract BibTeX arXiv:2001.11207

Code (0)

등록된 구현이 없습니다.

Tasks

Image-level Supervised Instance Segmentation Instance Segmentation object-detection Object Detection Segmentation Semantic Segmentation Weakly-supervised instance segmentation Weakly Supervised Object Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

RoIPool 설명 없음

Fast R-CNN Fast R-CNN is an object detection model that improves in its predecessor R-CNN in a number of ways. Instead of extracting CNN…

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Weakly Supervised Nuclei Segmentation via Instance Learning

2022-02-03 · Weizhen Liu, Qian He, Xuming He

Weakly supervised nuclei segmentation is a critical problem for pathological image analysis and greatly benefits the community due to the significant reduction of labeling cost. Adopting point annotations, previous metho…

Instance Segmentation Representation Learning Segmentation Semantic Segmentation

Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaboration

2022-12-15 · Liqi Yan, Qifan Wang, Siqi Ma, Jingang Wang 외

Instance segmentation in videos, which aims to segment and track multiple objects in video frames, has garnered a flurry of research attention in recent years. In this paper, we present a novel weakly supervised framewor…

Depth Estimation Instance Segmentation Optical Flow Estimation Segmentation+1

Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Images

2021-04-04 · CVPR 2021 1 · Xinggang Wang, Jiapei Feng, Bin Hu, Qi Ding 외

Humans have a strong class-agnostic object segmentation ability and can outline boundaries of unknown objects precisely, which motivates us to propose a box-supervised class-agnostic object segmentation (BoxCaseg) based …

Box-supervised Instance Segmentation Instance Segmentation Multi-Task Learning Object+4

Weakly- and Semi-Supervised Panoptic Segmentation

2018-08-10 · ECCV 2018 9 · Qizhu Li, Anurag Arnab, Philip H. S. Torr

We present a weakly supervised model that jointly performs both semantic- and instance-segmentation -- a particularly relevant problem given the substantial cost of obtaining pixel-perfect annotation for these tasks. In …

Instance Segmentation Panoptic Segmentation Segmentation Semantic Segmentation+3

Transformer based multiple instance learning for weakly supervised histopathology image segmentation

2022-05-18 · Ziniu Qian, Kailu Li, Maode Lai, Eric I-Chao Chang 외

Hispathological image segmentation algorithms play a critical role in computer aided diagnosis technology. The development of weakly supervised segmentation algorithm alleviates the problem of medical image annotation th…

Image Segmentation Multiple Instance Learning Segmentation Semantic Segmentation+2