Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation
The key challenge for few-shot semantic segmentation (FSS) is how to tailor a desirable interaction among support and query features and/or their prototypes, under the episodic training scenario. Most existing FSS methods implement such support-query interactions by solely leveraging plain operations - e.g., cosine similarity and feature concatenation - for segmenting the query objects. However, these interaction approaches usually cannot well capture the intrinsic object details in the query images that are widely encountered in FSS, e.g., if the query object to be segmented has holes and slots, inaccurate segmentation almost always happens. To this end, we propose a dynamic prototype convolution network (DPCN) to fully capture the aforementioned intrinsic details for accurate FSS. Specifically, in DPCN, a dynamic convolution module (DCM) is firstly proposed to generate dynamic kernels from support foreground, then information interaction is achieved by convolution operations over query features using these kernels. Moreover, we equip DPCN with a support activation module (SAM) and a feature filtering module (FFM) to generate pseudo mask and filter out background information for the query images, respectively. SAM and FFM together can mine enriched context information from the query features. Our DPCN is also flexible and efficient under the k-shot FSS setting. Extensive experiments on PASCAL-5i and COCO-20i show that DPCN yields superior performances under both 1-shot and 5-shot settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Semantic SegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SML: Semantic Meta-learning for Few-shot Semantic Segmentation
The significant amount of training data required for training Convolutional Neural Networks has become a bottleneck for applications like semantic segmentation. Few-shot semantic segmentation algorithms address this prob…
Few-Shot Semantic SegmentationMeta-LearningSegmentationSemantic SegmentationSCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive Background Prototypes
Few-shot semantic segmentation aims to segment novel-class objects in a query image with only a few annotated examples in support images. Most of advanced solutions exploit a metric learning framework that performs segme…
Few-Shot Semantic SegmentationMetric LearningSegmentationSemantic SegmentationPrototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentation
In this work, we address the challenging task of few-shot and zero-shot 3D point cloud semantic segmentation. The success of few-shot semantic segmentation in 2D computer vision is mainly driven by the pre-training on la…
Few-shot 3D semantic segmentationSegmentationPANet: Few-Shot Image Semantic Segmentation with Prototype Alignment
Despite the great progress made by deep CNNs in image semantic segmentation, they typically require a large number of densely-annotated images for training and are difficult to generalize to unseen object categories. Few…
Few-Shot Semantic SegmentationMetric LearningSegmentationSemantic SegmentationPart-aware Prototype Network for Few-shot Semantic Segmentation
Few-shot semantic segmentation aims to learn to segment new object classes with only a few annotated examples, which has a wide range of real-world applications. Most existing methods either focus on the restrictive sett…
Few-Shot Semantic SegmentationGraph Neural NetworkObjectSegmentation+2