Mining Latent Classes for Few-shot Segmentation
Few-shot segmentation (FSS) aims to segment unseen classes given only a few annotated samples. Existing methods suffer the problem of feature undermining, i.e. potential novel classes are treated as background during training phase. Our method aims to alleviate this problem and enhance the feature embedding on latent novel classes. In our work, we propose a novel joint-training framework. Based on conventional episodic training on support-query pairs, we add an additional mining branch that exploits latent novel classes via transferable sub-clusters, and a new rectification technique on both background and foreground categories to enforce more stable prototypes. Over and above that, our transferable sub-cluster has the ability to leverage extra unlabeled data for further feature enhancement. Extensive experiments on two FSS benchmarks demonstrate that our method outperforms previous state-of-the-art by a large margin of 3.7% mIOU on PASCAL-5i and 7.0% mIOU on COCO-20i at the cost of 74% fewer parameters and 2.5x faster inference speed. The source code is available at https://github.com/LiheYoung/MiningFSS.
Code (1)
Tasks
Few-Shot Semantic SegmentationSimilar Papers 제목 키워드 기반
FAPIS: A Few-shot Anchor-free Part-based Instance Segmenter
This paper is about few-shot instance segmentation, where training and test image sets do not share the same object classes. We specify and evaluate a new few-shot anchor-free part-based instance segmenter FAPIS. Our key…
Few-shot Instance SegmentationFew-Shot LearningInstance SegmentationObject+2Contrastive Enhancement Using Latent Prototype for Few-Shot Segmentation
Few-shot segmentation enables the model to recognize unseen classes with few annotated examples. Most existing methods adopt prototype learning architecture, where support prototype vectors are expanded and concatenated …
SegmentationOrganizing Background to Explore Latent Classes for Incremental Few-shot Semantic Segmentation
The goal of incremental Few-shot Semantic Segmentation (iFSS) is to extend pre-trained segmentation models to new classes via few annotated images without access to old training data. During incrementally learning novel …
Few-Shot Semantic SegmentationSemantic SegmentationBackground Clustering Pre-training for Few-shot Segmentation
Recent few-shot segmentation (FSS) methods introduce an extra pre-training stage before meta-training to obtain a stronger backbone, which has become a standard step in few-shot learning. Despite the effectiveness, curre…
Few-Shot Semantic SegmentationClass Similarity Transition: Decoupling Class Similarities and Imbalance from Generalized Few-shot Segmentation
In Generalized Few-shot Segmentation (GFSS), a model is trained with a large corpus of base class samples and then adapted on limited samples of novel classes. This paper focuses on the relevance between base and novel c…