Adaptive Masked Proxies for Few-Shot Segmentation
Deep learning has thrived by training on large-scale datasets. However, in robotics applications sample efficiency is critical. We propose a novel adaptive masked proxies method that constructs the final segmentation layer weights from few labelled samples. It utilizes multi-resolution average pooling on base embeddings masked with the label to act as a positive proxy for the new class, while fusing it with the previously learned class signatures. Our method is evaluated on PASCAL-$5^i$ dataset and outperforms the state-of-the-art in the few-shot semantic segmentation. Unlike previous methods, our approach does not require a second branch to estimate parameters or prototypes, which enables it to be used with 2-stream motion and appearance based segmentation networks. We further propose a novel setup for evaluating continual learning of object segmentation which we name incremental PASCAL (iPASCAL) where our method outperforms the baseline method. Our code is publicly available at https://github.com/MSiam/AdaptiveMaskedProxies.
Code (1)
Tasks
Continual LearningFew-Shot Semantic SegmentationSegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AMP: Adaptive Masked Proxies for Few-Shot Segmentation
Deep learning has thrived by training on large-scale datasets. However, in robotics applications sample efficiency is critical. We propose a novel adaptive masked proxies method that constructs the final segmentation lay…
Continual LearningFew-Shot Semantic SegmentationSegmentationSemantic SegmentationBeyond the Prototype: Divide-and-conquer Proxies for Few-shot Segmentation
Few-shot segmentation, which aims to segment unseen-class objects given only a handful of densely labeled samples, has received widespread attention from the community. Existing approaches typically follow the prototype …
DecoderFew-Shot Semantic SegmentationMeta-LearningSegmentation+1Adaptive Masked Weight Imprinting for Few-Shot Segmentation
Deep learning has mainly thrived by training on large-scale datasets. However, for continual learning in applications such as robotics, it is critical to incrementally update its model in a sample efficient manner. We pr…
Continual LearningSemantic SegmentationZiCo-BC: A Bias Corrected Zero-Shot NAS for Vision Tasks
Zero-Shot Neural Architecture Search (NAS) approaches propose novel training-free metrics called zero-shot proxies to substantially reduce the search time compared to the traditional training-based NAS. Despite the succe…
image-classificationImage ClassificationNeural Architecture Searchobject-detection+3Feature-Proxy Transformer for Few-Shot Segmentation
Few-shot segmentation (FSS) aims at performing semantic segmentation on novel classes given a few annotated support samples. With a rethink of recent advances, we find that the current FSS framework has deviated far from…
DecoderFew-Shot Semantic SegmentationSegmentationSemantic Segmentation