Background Clustering Pre-training for Few-shot Segmentation
Recent few-shot segmentation (FSS) methods introduce an extra pre-training stage before meta-training to obtain a stronger backbone, which has become a standard step in few-shot learning. Despite the effectiveness, current pre-training scheme suffers from the merged background problem: only base classes are labelled as foregrounds, making it hard to distinguish between novel classes and actual background. In this paper, we propose a new pre-training scheme for FSS via decoupling the novel classes from background, called Background Clustering Pre-Training (BCPT). Specifically, we adopt online clustering to the pixel embeddings of merged background to explore the underlying semantic structures, bridging the gap between pre-training and adaptation to novel classes. Given the clustering results, we further propose the background mining loss and leverage base classes to guide the clustering process, improving the quality and stability of clustering results. Experiments on PASCAL-5i and COCO-20i show that BCPT yields advanced performance. Code will be available.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Joint Optimization of Segmentation and Color Clustering
Binary energy optimization is a popular approach for segmenting a color image into foreground/background regions. To model the appearance of the regions, color, a relatively high dimensional feature, should be handled ef…
ClusteringSegmentationFew-Shot Medical Image Segmentation with High-Fidelity Prototypes
Few-shot Semantic Segmentation (FSS) aims to adapt a pretrained model to new classes with as few as a single labelled training sample per class. Despite the prototype based approaches have achieved substantial success, e…
Few-Shot Semantic SegmentationImage SegmentationMedical Image SegmentationSemantic SegmentationSemantic-Promoted Debiasing and Background Disambiguation for Zero-Shot Instance Segmentation
Zero-shot instance segmentation aims to detect and precisely segment objects of unseen categories without any training samples. Since the model is trained on seen categories, there is a strong bias that the model tends t…
Instance SegmentationSegmentationSemantic SegmentationZero-Shot Instance SegmentationSCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive Background Prototypes
Few-shot semantic segmentation aims to segment novel-class objects in a query image with only a few annotated examples in support images. Most of advanced solutions exploit a metric learning framework that performs segme…
Few-Shot Semantic SegmentationMetric LearningSegmentationSemantic SegmentationSCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentation
Incremental Few-Shot (IFS) segmentation aims to learn new categories over time from only a few annotations. Although widely studied in 2D, it remains underexplored for 3D point clouds. Existing methods suffer from catast…
Point Clouds