paper-with-me

Papers

Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather Conditions

2023-03-24 · CVPR 2023 1 · Tobias Kalb, Jürgen Beyerer

Deep neural networks for scene perception in automated vehicles achieve excellent results for the domains they were trained on. However, in real-world conditions, the domain of operation and its underlying data distribution are subject to change. Adverse weather conditions, in particular, can significantly decrease model performance when such data are not available during training.Additionally, when a model is incrementally adapted to a new domain, it suffers from catastrophic forgetting, causing a significant drop in performance on previously observed domains. Despite recent progress in reducing catastrophic forgetting, its causes and effects remain obscure. Therefore, we study how the representations of semantic segmentation models are affected during domain-incremental learning in adverse weather conditions. Our experiments and representational analyses indicate that catastrophic forgetting is primarily caused by changes to low-level features in domain-incremental learning and that learning more general features on the source domain using pre-training and image augmentations leads to efficient feature reuse in subsequent tasks, which drastically reduces catastrophic forgetting. These findings highlight the importance of methods that facilitate generalized features for effective continual learning algorithms.

📄 PDF Abstract BibTeX arXiv:2303.14115

Code (1)

tobiaskalb/feature-reuse-css 공식 구현 pytorch

Tasks

Continual LearningIncremental LearningSemantic Segmentation

Similar Papers 제목 키워드 기반

Improving Replay-Based Continual Semantic Segmentation with Smart Data Selection

2022-09-20 · Tobias Kalb, Björn Mauthe, Jürgen Beyerer

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge i…

Continual LearningContinual Semantic SegmentationIncremental LearningSegmentation+1

Continual Learning for Class- and Domain-Incremental Semantic Segmentation

2022-09-16 · Tobias Kalb, Masoud Roschani, Miriam Ruf, Jürgen Beyerer

The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in th…

class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationContinual Learning+9

Delving into Transformer for Incremental Semantic Segmentation

2022-11-18 · Zekai Xu, Mingyi Zhang, Jiayue Hou, Xing Gong 외

Incremental semantic segmentation(ISS) is an emerging task where old model is updated by incrementally adding new classes. At present, methods based on convolutional neural networks are dominant in ISS. However, studies …

DiversitySegmentationSemantic Segmentation

Gradient-Semantic Compensation for Incremental Semantic Segmentation

2023-07-20 · Wei Cong, Yang Cong, Jiahua Dong, Gan Sun 외

Incremental semantic segmentation aims to continually learn the segmentation of new coming classes without accessing the training data of previously learned classes. However, most current methods fail to address catastro…

SegmentationSemantic Segmentation

ProtoFlow: Mitigating Forgetting in Class-Incremental Remote Sensing Segmentation via Low-Curvature Prototype Flow

2026-04-03 · Jiekai Wu, Rong Fu, Chuangqi Li, Zijian Zhang 외 arxiv

Remote sensing segmentation in real deployment is inherently continual: new semantic categories emerge, and acquisition conditions shift across seasons, cities, and sensors. Despite recent progress, many incremental appr…

Incremental Learning