paper-with-me

홈 › Papers

Conditional Convolutions for Instance Segmentation

2020-03-12 · ECCV 2020 8 · Zhi Tian, Chunhua Shen, Hao Chen

We propose a simple yet effective instance segmentation framework, termed CondInst (conditional convolutions for instance segmentation). Top-performing instance segmentation methods such as Mask R-CNN rely on ROI operations (typically ROIPool or ROIAlign) to obtain the final instance masks. In contrast, we propose to solve instance segmentation from a new perspective. Instead of using instance-wise ROIs as inputs to a network of fixed weights, we employ dynamic instance-aware networks, conditioned on instances. CondInst enjoys two advantages: 1) Instance segmentation is solved by a fully convolutional network, eliminating the need for ROI cropping and feature alignment. 2) Due to the much improved capacity of dynamically-generated conditional convolutions, the mask head can be very compact (e.g., 3 conv. layers, each having only 8 channels), leading to significantly faster inference. We demonstrate a simpler instance segmentation method that can achieve improved performance in both accuracy and inference speed. On the COCO dataset, we outperform a few recent methods including well-tuned Mask RCNN baselines, without longer training schedules needed. Code is available: https://github.com/aim-uofa/adet

📄 PDF Abstract BibTeX arXiv:2003.05664

Code (7)

aim-uofa/AdelaiDet 공식 구현 pytorch
Pxtri2156/AdelaiDet_v2 pytorch
blueardour/AdelaiDet pytorch
quangvy2703/ABCNet-ESRGAN-SRTEXT pytorch
zhaozhijie1997/Unifed-Lane-and-Traffic-Sign-detection pytorch
zhubinQAQ/Ins pytorch
zymk9/Yet-Another-Anime-Segmenter

Tasks

Instance SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
CondInst 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
RoIPool 설명 없음
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Instance and Panoptic Segmentation Using Conditional Convolutions

2021-02-05 · Zhi Tian, BoWen Zhang, Hao Chen, Chunhua Shen

We propose a simple yet effective framework for instance and panoptic segmentation, termed CondInst (conditional convolutions for instance and panoptic segmentation). In the literature, top-performing instance segmentati…

Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation

Implicit Feature Refinement for Instance Segmentation

2021-12-09 · Lufan Ma, Tiancai Wang, Bin Dong, Jiangpeng Yan 외

We propose a novel implicit feature refinement module for high-quality instance segmentation. Existing image/video instance segmentation methods rely on explicitly stacked convolutions to refine instance features before …

Instance SegmentationObject RecognitionSegmentationSemantic Segmentation+1

3D Instances as 1D Kernels

2022-07-15 · Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu 외

We introduce a 3D instance representation, termed instance kernels, where instances are represented by one-dimensional vectors that encode the semantic, positional, and shape information of 3D instances. We show that ins…

3D Instance SegmentationInstance SegmentationSemantic Segmentation

STC: Spatio-Temporal Contrastive Learning for Video Instance Segmentation

2022-02-08 · Zhengkai Jiang, Zhangxuan Gu, Jinlong Peng, Hang Zhou 외

Video Instance Segmentation (VIS) is a task that simultaneously requires classification, segmentation, and instance association in a video. Recent VIS approaches rely on sophisticated pipelines to achieve this goal, incl…

Contrastive LearningInstance SegmentationSegmentationSemantic Segmentation+1

Unifying Instance and Panoptic Segmentation with Dynamic Rank-1 Convolutions

2020-11-19 · Hao Chen, Chunhua Shen, Zhi Tian

Recently, fully-convolutional one-stage networks have shown superior performance comparing to two-stage frameworks for instance segmentation as typically they can generate higher-quality mask predictions with less comput…

Instance SegmentationMulti-Task LearningPanoptic SegmentationSegmentation+1