paper-with-me

홈 › Papers

Implicit Feature Refinement for Instance Segmentation

2021-12-09 · Lufan Ma, Tiancai Wang, Bin Dong, Jiangpeng Yan, Xiu Li, Xiangyu Zhang

We propose a novel implicit feature refinement module for high-quality instance segmentation. Existing image/video instance segmentation methods rely on explicitly stacked convolutions to refine instance features before the final prediction. In this paper, we first give an empirical comparison of different refinement strategies,which reveals that the widely-used four consecutive convolutions are not necessary. As an alternative, weight-sharing convolution blocks provides competitive performance. When such block is iterated for infinite times, the block output will eventually convergeto an equilibrium state. Based on this observation, the implicit feature refinement (IFR) is developed by constructing an implicit function. The equilibrium state of instance features can be obtained by fixed-point iteration via a simulated infinite-depth network. Our IFR enjoys several advantages: 1) simulates an infinite-depth refinement network while only requiring parameters of single residual block; 2) produces high-level equilibrium instance features of global receptive field; 3) serves as a plug-and-play general module easily extended to most object recognition frameworks. Experiments on the COCO and YouTube-VIS benchmarks show that our IFR achieves improved performance on state-of-the-art image/video instance segmentation frameworks, while reducing the parameter burden (e.g.1% AP improvement on Mask R-CNN with only 30.0% parameters in mask head). Code is made available at https://github.com/lufanma/IFR.git

📄 PDF Abstract BibTeX arXiv:2112.04709

Code (1)

lufanma/ifr 공식 구현 pytorch

Tasks

Instance SegmentationObject RecognitionSegmentationSemantic SegmentationVideo Instance Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Object-Guided Instance Segmentation With Auxiliary Feature Refinement for Biological Images

2021-06-14 · Jingru Yi, Pengxiang Wu, Hui Tang, Bo Liu 외

Instance segmentation is of great importance for many biological applications, such as study of neural cell interactions, plant phenotyping, and quantitatively measuring how cells react to drug treatment. In this paper, …

Instance SegmentationObjectPlant PhenotypingSegmentation+1

Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentation

2021-04-12 · CVPR 2021 1 · Chufeng Tang, Hang Chen, Xiao Li, Jianmin Li 외

Tremendous efforts have been made on instance segmentation but the mask quality is still not satisfactory. The boundaries of predicted instance masks are usually imprecise due to the low spatial resolution of feature map…

Instance SegmentationSegmentationSemantic Segmentation

SEP-YOLO: Fourier-Domain Feature Representation for Transparent Object Instance Segmentation

2026-03-03 · Fengming Zhang, Tao Yan, Jianchao Huang arxiv

Transparent object instance segmentation presents significant challenges in computer vision, due to the inherent properties of transparent objects, including boundary blur, low contrast, and high dependence on background…

Instance Segmentation

Leveraging Adaptive Implicit Representation Mapping for Ultra High-Resolution Image Segmentation

2024-07-31 · Ziyu Zhao, Xiaoguang Li, Pingping Cai, Canyu Zhang 외

Implicit representation mapping (IRM) can translate image features to any continuous resolution, showcasing its potent capability for ultra-high-resolution image segmentation refinement. Current IRM-based methods for ref…

Image SegmentationSegmentationSemantic Segmentation

Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement

2026-03-30 · Jingze Su, Tianle Zhu, Jiaxin Cai, Zhiyi Wang 외 arxiv

Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leverag…

parameter-efficient fine-tuningInstance Segmentation