Class-incremental Continual Learning for Instance Segmentation with Image-level Weak Supervision
Instance segmentation requires labor-intensive manual labeling of the contours of complex objects in images for training. The labels can also be provided incrementally in practice to balance the human labor in different time steps. However, research on incremental learning for instance segmentation with only weak labels is still lacking. In this paper, we propose a continual-learning method to segment object instances from image-level labels. Unlike most weakly-supervised instance segmentation (WSIS) which relies on traditional object proposals, we transfer the semantic knowledge from weakly-supervised semantic segmentation (WSSS) to WSIS to generate instance cues. To address the background shift problem in continual learning, we employ the old class segmentation results generated by the previous model to provide more reliable semantic and peak hypotheses. To our knowledge, this is the first work on weakly-supervised continual learning for instance segmentation of images. Experimental results show that our method can achieve better performance on Pascal VOC and COCO datasets under various incremental settings.
Code (1)
Tasks
Continual LearningIncremental LearningInstance SegmentationSegmentationSemantic SegmentationWeakly-supervised instance segmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Continual Learning for Image Segmentation with Dynamic Query
Image segmentation based on continual learning exhibits a critical drop of performance, mainly due to catastrophic forgetting and background shift, as they are required to incorporate new classes continually. In this pap…
Continual LearningDiversityImage SegmentationInstance Segmentation+4Continual Learning for Class- and Domain-Incremental Semantic Segmentation
The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in th…
class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationContinual Learning+9SimCS: Simulation for Domain Incremental Online Continual Segmentation
Continual Learning is a step towards lifelong intelligence where models continuously learn from recently collected data without forgetting previous knowledge. Existing continual learning approaches mostly focus on image …
Autonomous DrivingContinual Learningimage-classificationImage Classification+1CRISP: Contrastive Residual Injection and Semantic Prompting for Continual Video Instance Segmentation
Continual video instance segmentation demands both the plasticity to absorb new object categories and the stability to retain previously learned ones, all while preserving temporal consistency across frames. In this work…
Video Instance SegmentationContrastive LearningContinual Multiple Instance Learning with Enhanced Localization for Histopathological Whole Slide Image Analysis
Multiple instance learning (MIL) significantly reduced annotation costs via bag-level weak labels for large-scale images, such as histopathological whole slide images (WSIs). However, its adaptability to continual tasks …
Multiple Instance LearningSemantic SegmentationIncremental Learning