Implicit Feature Refinement for Instance Segmentation
We propose a novel implicit feature refinement module for high-quality instance segmentation. Existing image/video instance segmentation methods rely on explicitly stacked convolutions to refine instance features before the final prediction. In this paper, we first give an empirical comparison of different refinement strategies,which reveals that the widely-used four consecutive convolutions are not necessary. As an alternative, weight-sharing convolution blocks provides competitive performance. When such block is iterated for infinite times, the block output will eventually convergeto an equilibrium state. Based on this observation, the implicit feature refinement (IFR) is developed by constructing an implicit function. The equilibrium state of instance features can be obtained by fixed-point iteration via a simulated infinite-depth network. Our IFR enjoys several advantages: 1) simulates an infinite-depth refinement network while only requiring parameters of single residual block; 2) produces high-level equilibrium instance features of global receptive field; 3) serves as a plug-and-play general module easily extended to most object recognition frameworks. Experiments on the COCO and YouTube-VIS benchmarks show that our IFR achieves improved performance on state-of-the-art image/video instance segmentation frameworks, while reducing the parameter burden (e.g.1% AP improvement on Mask R-CNN with only 30.0% parameters in mask head). Code is made available at https://github.com/lufanma/IFR.git
Code (1)
Tasks
Instance SegmentationObject RecognitionSegmentationSemantic SegmentationVideo Instance SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Object-Guided Instance Segmentation With Auxiliary Feature Refinement for Biological Images
Instance segmentation is of great importance for many biological applications, such as study of neural cell interactions, plant phenotyping, and quantitatively measuring how cells react to drug treatment. In this paper, …
Instance SegmentationObjectPlant PhenotypingSegmentation+1Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentation
Tremendous efforts have been made on instance segmentation but the mask quality is still not satisfactory. The boundaries of predicted instance masks are usually imprecise due to the low spatial resolution of feature map…
Instance SegmentationSegmentationSemantic SegmentationSEP-YOLO: Fourier-Domain Feature Representation for Transparent Object Instance Segmentation
Transparent object instance segmentation presents significant challenges in computer vision, due to the inherent properties of transparent objects, including boundary blur, low contrast, and high dependence on background…
Instance SegmentationLeveraging Adaptive Implicit Representation Mapping for Ultra High-Resolution Image Segmentation
Implicit representation mapping (IRM) can translate image features to any continuous resolution, showcasing its potent capability for ultra-high-resolution image segmentation refinement. Current IRM-based methods for ref…
Image SegmentationSegmentationSemantic SegmentationAdapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement
Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leverag…
parameter-efficient fine-tuningInstance Segmentation