Class-Incremental Learning for Semantic Segmentation Re-Using Neither Old Data Nor Old Labels
While neural networks trained for semantic segmentation are essential for perception in autonomous driving, most current algorithms assume a fixed number of classes, presenting a major limitation when developing new autonomous driving systems with the need of additional classes. In this paper we present a technique implementing class-incremental learning for semantic segmentation without using the labeled data the model was initially trained on. Previous approaches still either rely on labels for both old and new classes, or fail to properly distinguish between them. We show how to overcome these problems with a novel class-incremental learning technique, which nonetheless requires labels only for the new classes. Specifically, (i) we introduce a new loss function that neither relies on old data nor on old labels, (ii) we show how new classes can be integrated in a modular fashion into pretrained semantic segmentation models, and finally (iii) we re-implement previous approaches in a unified setting to compare them to ours. We evaluate our method on the Cityscapes dataset, where we exceed the mIoU performance of all baselines by 3.5% absolute reaching a result, which is only 2.2% absolute below the upper performance limit of single-stage training, relying on all data and labels simultaneously.
Code (1)
Tasks
Autonomous Drivingclass-incremental learningClass Incremental LearningIncremental LearningSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Continual Learning for Class- and Domain-Incremental Semantic Segmentation
The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in th…
class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationContinual Learning+9Open-world Semantic Segmentation for LIDAR Point Clouds
Current methods for LIDAR semantic segmentation are not robust enough for real-world applications, e.g., autonomous driving, since it is closed-set and static. The closed-set assumption makes the network only able to out…
Autonomous DrivingIncremental LearningLIDAR Semantic SegmentationSegmentation+1IPSeg: Image Posterior Mitigates Semantic Drift in Class-Incremental Segmentation
Class incremental learning aims to enable models to learn from sequential, non-stationary data streams across different tasks without catastrophic forgetting. In class incremental semantic segmentation (CISS), the semant…
class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationIncremental Learning+1Advancing Incremental Few-shot Semantic Segmentation via Semantic-guided Relation Alignment and Adaptation
Incremental few-shot semantic segmentation (IFSS) aims to incrementally extend a semantic segmentation model to novel classes according to only a few pixel-level annotated data, while preserving its segmentation capabili…
Few-Shot Semantic SegmentationIncremental LearningRelationSegmentation+1Incremental Learning in Semantic Segmentation from Image Labels
Although existing semantic segmentation approaches achieve impressive results, they still struggle to update their models incrementally as new categories are uncovered. Furthermore, pixel-by-pixel annotations are expensi…
Incremental LearningSegmentationSemantic Segmentation