Continual Detection Transformer for Incremental Object Detection
Incremental object detection (IOD) aims to train an object detector in phases, each with annotations for new object categories. As other incremental settings, IOD is subject to catastrophic forgetting, which is often addressed by techniques such as knowledge distillation (KD) and exemplar replay (ER). However, KD and ER do not work well if applied directly to state-of-the-art transformer-based object detectors such as Deformable DETR and UP-DETR. In this paper, we solve these issues by proposing a ContinuaL DEtection TRansformer (CL-DETR), a new method for transformer-based IOD which enables effective usage of KD and ER in this context. First, we introduce a Detector Knowledge Distillation (DKD) loss, focusing on the most informative and reliable predictions from old versions of the model, ignoring redundant background predictions, and ensuring compatibility with the available ground-truth labels. We also improve ER by proposing a calibration strategy to preserve the label distribution of the training set, therefore better matching training and testing statistics. We conduct extensive experiments on COCO 2017 and demonstrate that CL-DETR achieves state-of-the-art results in the IOD setting.
Code (0)
등록된 구현이 없습니다.
Tasks
Class-Incremental Object DetectionKnowledge DistillationObjectobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Hierarchical Neural Collapse Detection Transformer for Class Incremental Object Detection
Recently, object detection models have witnessed notable performance improvements, particularly with transformer-based models. However, new objects frequently appear in the real world, requiring detection models to conti…
Class-Incremental Object DetectionObjectobject-detectionObject DetectionContinual Object Detection: A review of definitions, strategies, and challenges
The field of Continual Learning investigates the ability to learn consecutive tasks without losing performance on those previously learned. Its focus has been mainly on incremental classification tasks. We believe that r…
Autonomous VehiclesClass-Incremental Object DetectionContinual LearningObject+2Efficient Parameter Mining and Freezing for Continual Object Detection
Continual Object Detection is essential for enabling intelligent agents to interact proactively with humans in real-world settings. While parameter-isolation strategies have been extensively explored in the context of co…
Continual LearningIncremental LearningObjectobject-detection+1Teach YOLO to Remember: A Self-Distillation Approach for Continual Object Detection
Real-time object detectors like YOLO achieve exceptional performance when trained on large datasets for multiple epochs. However, in real-world scenarios where data arrives incrementally, neural networks suffer from cata…
class-incremental learningClass Incremental LearningContinual LearningIncremental Learning+3CLAD: A realistic Continual Learning benchmark for Autonomous Driving
In this paper we describe the design and the ideas motivating a new Continual Learning benchmark for Autonomous Driving (CLAD), that focuses on the problems of object classification and object detection. The benchmark ut…
Autonomous DrivingContinual LearningObjectobject-detection+2