paper-with-me

Papers

Modeling the Background for Incremental Learning in Semantic Segmentation

2020-02-03 · CVPR 2020 6 · Fabio Cermelli, Massimiliano Mancini, Samuel Rota Bulò, Elisa Ricci, Barbara Caputo

Despite their effectiveness in a wide range of tasks, deep architectures suffer from some important limitations. In particular, they are vulnerable to catastrophic forgetting, i.e. they perform poorly when they are required to update their model as new classes are available but the original training set is not retained. This paper addresses this problem in the context of semantic segmentation. Current strategies fail on this task because they do not consider a peculiar aspect of semantic segmentation: since each training step provides annotation only for a subset of all possible classes, pixels of the background class (i.e. pixels that do not belong to any other classes) exhibit a semantic distribution shift. In this work we revisit classical incremental learning methods, proposing a new distillation-based framework which explicitly accounts for this shift. Furthermore, we introduce a novel strategy to initialize classifier's parameters, thus preventing biased predictions toward the background class. We demonstrate the effectiveness of our approach with an extensive evaluation on the Pascal-VOC 2012 and ADE20K datasets, significantly outperforming state of the art incremental learning methods.

📄 PDF Abstract BibTeX arXiv:2002.00718

Code (1)

fcdl94/MiB pytorch

Tasks

Continual LearningDisjoint 10-1Disjoint 15-1Disjoint 15-5Domain 1-1Domain 11-1Domain 11-5Incremental LearningOverlapped 10-1Overlapped 19-1SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Modeling the Background for Incremental and Weakly-Supervised Semantic Segmentation

2022-01-31 · Fabio Cermelli, Massimiliano Mancini, Samuel Rota Buló, Elisa Ricci 외

Deep neural networks have enabled major progresses in semantic segmentation. However, even the most advanced neural architectures suffer from important limitations. First, they are vulnerable to catastrophic forgetting, …

SegmentationSemantic SegmentationWeakly supervised segmentationWeakly supervised Semantic Segmentation+1

Background Adaptation with Residual Modeling for Exemplar-Free Class-Incremental Semantic Segmentation

2024-07-13 · Anqi Zhang, Guangyu Gao

Class Incremental Semantic Segmentation~(CISS), within Incremental Learning for semantic segmentation, targets segmenting new categories while reducing the catastrophic forgetting on the old categories.Besides, backgroun…

Class-Incremental Semantic SegmentationExemplar-FreeIncremental LearningKnowledge Distillation+2

Modeling Unknown Semantic Labels as Uncertainty in the Prediction: Evidential Deep Learning for Class-Incremental Semantic Segmentation

2021-09-29 · Karl Holmquist, Michael Felsberg, Lena Klasen

Class-Incremental Learning is an essential component for expanding the knowledge of previously trained neural networks. This is especially useful if the system needs to be able to handle new objects but the original tra…

class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationClustering+2

Gradient-Semantic Compensation for Incremental Semantic Segmentation

2023-07-20 · Wei Cong, Yang Cong, Jiahua Dong, Gan Sun 외

Incremental semantic segmentation aims to continually learn the segmentation of new coming classes without accessing the training data of previously learned classes. However, most current methods fail to address catastro…

SegmentationSemantic Segmentation

Attribution-aware Weight Transfer: A Warm-Start Initialization for Class-Incremental Semantic Segmentation

2022-10-13 · Dipam Goswami, René Schuster, Joost Van de Weijer, Didier Stricker

In class-incremental semantic segmentation (CISS), deep learning architectures suffer from the critical problems of catastrophic forgetting and semantic background shift. Although recent works focused on these issues, ex…

Class-Incremental Semantic SegmentationContinual LearningOverlapped 100-10Overlapped 100-5+8