Response-based Distillation for Incremental Object Detection
Traditional object detection are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting. Knowledge distillation is a straightforward way to mitigate catastrophic forgetting. In Incremental Object Detection (IOD), previous work mainly focuses on feature-level knowledge distillation, but the different response of detector has not been fully explored yet. In this paper, we propose a fully response-based incremental distillation method focusing on learning response from detection bounding boxes and classification predictions. Firstly, our method transferring category knowledge while equipping student model with the ability to retain localization knowledge during incremental learning. In addition, we further evaluate the qualities of all locations and provides valuable response by adaptive pseudo-label selection (APS) strategies. Finally, we elucidate that knowledge from different responses should be assigned with different importance during incremental distillation. Extensive experiments conducted on MS COCO demonstrate significant advantages of our method, which substantially narrow the performance gap towards full training.
Code (0)
등록된 구현이 없습니다.
Tasks
Incremental LearningKnowledge DistillationObjectobject-detectionObject DetectionPseudo LabelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation
Traditional object detectors are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will lead to catastrophic forgetting. Knowledge distillation is a…
Class-Incremental Object DetectionIncremental LearningKnowledge Distillationobject-detection+1I3DOD: Towards Incremental 3D Object Detection via Prompting
3D object detection has achieved significant performance in many fields, e.g., robotics system, autonomous driving, and augmented reality. However, most existing methods could cause catastrophic forgetting of old classes…
3D Object DetectionAutonomous DrivingObjectobject-detection+2Refined Response Distillation for Class-Incremental Player Detection
Detecting players from sports broadcast videos is essential for intelligent event analysis. However, existing methods assume fixed player categories, incapably accommodating the real-world scenarios where categories cont…
Knowledge Distillationobject-detectionObject DetectionAlleviating Catastrophic Forgetting of Incremental Object Detection via Within-Class and Between-Class Knowledge Distillation
Incremental object detection (IOD) task requires a model to learn continually from newly added data. However, directly fine-tuning a well-trained detection model on a new task will sharply decrease the performance on…
Knowledge Distillationobject-detectionObject DetectionMulti-Task Incremental Learning for Object Detection
Multi-task learns multiple tasks, while sharing knowledge and computation among them. However, it suffers from catastrophic forgetting of previous knowledge when learned incrementally without access to the old data. Most…
Incremental LearningObjectobject-detectionObject Detection