Incremental Few-Shot Instance Segmentation
Few-shot instance segmentation methods are promising when labeled training data for novel classes is scarce. However, current approaches do not facilitate flexible addition of novel classes. They also require that examples of each class are provided at train and test time, which is memory intensive. In this paper, we address these limitations by presenting the first incremental approach to few-shot instance segmentation: iMTFA. We learn discriminative embeddings for object instances that are merged into class representatives. Storing embedding vectors rather than images effectively solves the memory overhead problem. We match these class embeddings at the RoI-level using cosine similarity. This allows us to add new classes without the need for further training or access to previous training data. In a series of experiments, we consistently outperform the current state-of-the-art. Moreover, the reduced memory requirements allow us to evaluate, for the first time, few-shot instance segmentation performance on all classes in COCO jointly.
Code (1)
Tasks
Few-shot Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
SAM-IF: Leveraging SAM for Incremental Few-Shot Instance Segmentation
We propose SAM-IF, a novel method for incremental few-shot instance segmentation leveraging the Segment Anything Model (SAM). SAM-IF addresses the challenges of class-agnostic instance segmentation by introducing a multi…
DecoderFew-shot Instance SegmentationFew-Shot LearningIncremental Learning+3iFS-RCNN: An Incremental Few-shot Instance Segmenter
This paper addresses incremental few-shot instance segmentation, where a few examples of new object classes arrive when access to training examples of old classes is not available anymore, and the goal is to perform well…
Few-shot Instance SegmentationInstance SegmentationObjectSemantic SegmentationTask Consistent Prototype Learning for Incremental Few-shot Semantic Segmentation
Incremental Few-Shot Semantic Segmentation (iFSS) tackles a task that requires a model to continually expand its segmentation capability on novel classes using only a few annotated examples. Typical incremental approache…
Few-Shot Semantic SegmentationIncremental LearningMeta-LearningSemantic SegmentationUIFormer: A Unified Transformer-based Framework for Incremental Few-Shot Object Detection and Instance Segmentation
This paper introduces a novel framework for unified incremental few-shot object detection (iFSOD) and instance segmentation (iFSIS) using the Transformer architecture. Our goal is to create an optimal solution for situat…
DecoderFew-Shot Object DetectionIncremental LearningInstance Segmentation+4Class-incremental Continual Learning for Instance Segmentation with Image-level Weak Supervision
Instance segmentation requires labor-intensive manual labeling of the contours of complex objects in images for training. The labels can also be provided incrementally in practice to balance the human labor in differ…
Continual LearningIncremental LearningInstance SegmentationSegmentation+4