Self-Regularized Prototypical Network for Few-Shot Semantic Segmentation
The deep CNNs in image semantic segmentation typically require a large number of densely-annotated images for training and have difficulties in generalizing to unseen object categories. Therefore, few-shot segmentation has been developed to perform segmentation with just a few annotated examples. In this work, we tackle the few-shot segmentation using a self-regularized prototypical network (SRPNet) based on prototype extraction for better utilization of the support information. The proposed SRPNet extracts class-specific prototype representations from support images and generates segmentation masks for query images by a distance metric - the fidelity. A direct yet effective prototype regularization on support set is proposed in SRPNet, in which the generated prototypes are evaluated and regularized on the support set itself. The extent to which the generated prototypes restore the support mask imposes an upper limit on performance. The performance on the query set should never exceed the upper limit no matter how complete the knowledge is generalized from support set to query set. With the specific prototype regularization, SRPNet fully exploits knowledge from the support and offers high-quality prototypes that are representative for each semantic class and meanwhile discriminative for different classes. The query performance is further improved by an iterative query inference (IQI) module that combines a set of regularized prototypes. Our proposed SRPNet achieves new state-of-art performance on 1-shot and 5-shot segmentation benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Semantic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs
Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot L…
Adversarial RobustnessFew-Shot LearningOrgan SegmentationSegmentation+1Attention-Enhanced Prototypical Learning for Few-Shot Infrastructure Defect Segmentation
Few-shot semantic segmentation is vital for deep learning-based infrastructure inspection applications, where labeled training examples are scarce and expensive. Although existing deep learning frameworks perform well, t…
Few-Shot Semantic SegmentationPrototypical Kernel Learning and Open-set Foreground Perception for Generalized Few-shot Semantic Segmentation
Generalized Few-shot Semantic Segmentation (GFSS) extends Few-shot Semantic Segmentation (FSS) to simultaneously segment unseen classes and seen classes during evaluation. Previous works leverage additional branch or pro…
Few-Shot Semantic SegmentationGeneralized Few-Shot Semantic SegmentationSegmentationSemantic SegmentationPrototypical Matching and Open Set Rejection for Zero-Shot Semantic Segmentation
The deep learning methods in addressing semantic segmentation typically demand vast amount of pixel-wise annotated training samples. In this work, we present zero-shot semantic segmentation, which aims to identify no…
SegmentationSemantic SegmentationZero-Shot Semantic SegmentationSelf-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotation
Few-shot semantic segmentation (FSS) has great potential for medical imaging applications. Most of the existing FSS techniques require abundant annotated semantic classes for training. However, these methods may not be a…
Cardiac SegmentationFew-Shot Semantic SegmentationImage SegmentationMedical Image Segmentation+4