Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather Conditions
Deep neural networks for scene perception in automated vehicles achieve excellent results for the domains they were trained on. However, in real-world conditions, the domain of operation and its underlying data distribution are subject to change. Adverse weather conditions, in particular, can significantly decrease model performance when such data are not available during training.Additionally, when a model is incrementally adapted to a new domain, it suffers from catastrophic forgetting, causing a significant drop in performance on previously observed domains. Despite recent progress in reducing catastrophic forgetting, its causes and effects remain obscure. Therefore, we study how the representations of semantic segmentation models are affected during domain-incremental learning in adverse weather conditions. Our experiments and representational analyses indicate that catastrophic forgetting is primarily caused by changes to low-level features in domain-incremental learning and that learning more general features on the source domain using pre-training and image augmentations leads to efficient feature reuse in subsequent tasks, which drastically reduces catastrophic forgetting. These findings highlight the importance of methods that facilitate generalized features for effective continual learning algorithms.
Code (1)
Tasks
Continual LearningIncremental LearningSemantic SegmentationSimilar Papers 제목 키워드 기반
Improving Replay-Based Continual Semantic Segmentation with Smart Data Selection
Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge i…
Continual LearningContinual Semantic SegmentationIncremental LearningSegmentation+1Continual Learning for Class- and Domain-Incremental Semantic Segmentation
The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in th…
class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationContinual Learning+9Delving into Transformer for Incremental Semantic Segmentation
Incremental semantic segmentation(ISS) is an emerging task where old model is updated by incrementally adding new classes. At present, methods based on convolutional neural networks are dominant in ISS. However, studies …
DiversitySegmentationSemantic SegmentationGradient-Semantic Compensation for Incremental Semantic Segmentation
Incremental semantic segmentation aims to continually learn the segmentation of new coming classes without accessing the training data of previously learned classes. However, most current methods fail to address catastro…
SegmentationSemantic SegmentationProtoFlow: Mitigating Forgetting in Class-Incremental Remote Sensing Segmentation via Low-Curvature Prototype Flow
Remote sensing segmentation in real deployment is inherently continual: new semantic categories emerge, and acquisition conditions shift across seasons, cities, and sensors. Despite recent progress, many incremental appr…
Incremental Learning