Adaptive Prototype Learning and Allocation for Few-Shot Segmentation
Prototype learning is extensively used for few-shot segmentation. Typically, a single prototype is obtained from the support feature by averaging the global object information. However, using one prototype to represent all the information may lead to ambiguities. In this paper, we propose two novel modules, named superpixel-guided clustering (SGC) and guided prototype allocation (GPA), for multiple prototype extraction and allocation. Specifically, SGC is a parameter-free and training-free approach, which extracts more representative prototypes by aggregating similar feature vectors, while GPA is able to select matched prototypes to provide more accurate guidance. By integrating the SGC and GPA together, we propose the Adaptive Superpixel-guided Network (ASGNet), which is a lightweight model and adapts to object scale and shape variation. In addition, our network can easily generalize to k-shot segmentation with substantial improvement and no additional computational cost. In particular, our evaluations on COCO demonstrate that ASGNet surpasses the state-of-the-art method by 5% in 5-shot segmentation.
Code (2)
Tasks
ClusteringFew-Shot Semantic SegmentationSegmentationSimilar Papers 제목 키워드 기반
APANet: Adaptive Prototypes Alignment Network for Few-Shot Semantic Segmentation
Few-shot semantic segmentation aims to segment novel-class objects in a given query image with only a few labeled support images. Most advanced solutions exploit a metric learning framework that performs segmentation thr…
Few-Shot Semantic SegmentationMetric LearningSegmentationSemantic SegmentationMulti-grained Temporal Prototype Learning for Few-shot Video Object Segmentation
Few-Shot Video Object Segmentation (FSVOS) aims to segment objects in a query video with the same category defined by a few annotated support images. However, this task was seldom explored. In this work, based on IPMT, a…
Image SegmentationSegmentationSemantic SegmentationVideo Object Segmentation+1Adaptive FSS: A Novel Few-Shot Segmentation Framework via Prototype Enhancement
The Few-Shot Segmentation (FSS) aims to accomplish the novel class segmentation task with a few annotated images. Current FSS research based on meta-learning focus on designing a complex interaction mechanism between the…
Meta-LearningSPENet: Self-guided Prototype Enhancement Network for Few-shot Medical Image Segmentation
Few-Shot Medical Image Segmentation (FSMIS) aims to segment novel classes of medical objects using only a few labeled images. Prototype-based methods have made significant progress in addressing FSMIS. However, they typi…
Medical Image SegmentationDomain-invariant Prototypes for Semantic Segmentation
Deep Learning has greatly advanced the performance of semantic segmentation, however, its success relies on the availability of large amounts of annotated data for training. Hence, many efforts have been devoted to domai…
Domain AdaptationFew-Shot LearningSegmentationSemantic Segmentation