Modeling the Background for Incremental Learning in Semantic Segmentation
Despite their effectiveness in a wide range of tasks, deep architectures suffer from some important limitations. In particular, they are vulnerable to catastrophic forgetting, i.e. they perform poorly when they are required to update their model as new classes are available but the original training set is not retained. This paper addresses this problem in the context of semantic segmentation. Current strategies fail on this task because they do not consider a peculiar aspect of semantic segmentation: since each training step provides annotation only for a subset of all possible classes, pixels of the background class (i.e. pixels that do not belong to any other classes) exhibit a semantic distribution shift. In this work we revisit classical incremental learning methods, proposing a new distillation-based framework which explicitly accounts for this shift. Furthermore, we introduce a novel strategy to initialize classifier's parameters, thus preventing biased predictions toward the background class. We demonstrate the effectiveness of our approach with an extensive evaluation on the Pascal-VOC 2012 and ADE20K datasets, significantly outperforming state of the art incremental learning methods.
Code (1)
Tasks
Continual LearningDisjoint 10-1Disjoint 15-1Disjoint 15-5Domain 1-1Domain 11-1Domain 11-5Incremental LearningOverlapped 10-1Overlapped 19-1SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Modeling the Background for Incremental and Weakly-Supervised Semantic Segmentation
Deep neural networks have enabled major progresses in semantic segmentation. However, even the most advanced neural architectures suffer from important limitations. First, they are vulnerable to catastrophic forgetting, …
SegmentationSemantic SegmentationWeakly supervised segmentationWeakly supervised Semantic Segmentation+1Background Adaptation with Residual Modeling for Exemplar-Free Class-Incremental Semantic Segmentation
Class Incremental Semantic Segmentation~(CISS), within Incremental Learning for semantic segmentation, targets segmenting new categories while reducing the catastrophic forgetting on the old categories.Besides, backgroun…
Class-Incremental Semantic SegmentationExemplar-FreeIncremental LearningKnowledge Distillation+2Modeling Unknown Semantic Labels as Uncertainty in the Prediction: Evidential Deep Learning for Class-Incremental Semantic Segmentation
Class-Incremental Learning is an essential component for expanding the knowledge of previously trained neural networks. This is especially useful if the system needs to be able to handle new objects but the original tra…
class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationClustering+2Gradient-Semantic Compensation for Incremental Semantic Segmentation
Incremental semantic segmentation aims to continually learn the segmentation of new coming classes without accessing the training data of previously learned classes. However, most current methods fail to address catastro…
SegmentationSemantic SegmentationAttribution-aware Weight Transfer: A Warm-Start Initialization for Class-Incremental Semantic Segmentation
In class-incremental semantic segmentation (CISS), deep learning architectures suffer from the critical problems of catastrophic forgetting and semantic background shift. Although recent works focused on these issues, ex…
Class-Incremental Semantic SegmentationContinual LearningOverlapped 100-10Overlapped 100-5+8