paper-with-me

홈 › Papers

Response-based Distillation for Incremental Object Detection

2021-10-26 · Tao Feng, Mang Wang

Traditional object detection are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting. Knowledge distillation is a straightforward way to mitigate catastrophic forgetting. In Incremental Object Detection (IOD), previous work mainly focuses on feature-level knowledge distillation, but the different response of detector has not been fully explored yet. In this paper, we propose a fully response-based incremental distillation method focusing on learning response from detection bounding boxes and classification predictions. Firstly, our method transferring category knowledge while equipping student model with the ability to retain localization knowledge during incremental learning. In addition, we further evaluate the qualities of all locations and provides valuable response by adaptive pseudo-label selection (APS) strategies. Finally, we elucidate that knowledge from different responses should be assigned with different importance during incremental distillation. Extensive experiments conducted on MS COCO demonstrate significant advantages of our method, which substantially narrow the performance gap towards full training.

📄 PDF Abstract BibTeX arXiv:2110.13471

Code (0)

등록된 구현이 없습니다.

Tasks

Incremental LearningKnowledge DistillationObjectobject-detectionObject DetectionPseudo Label

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation

2022-04-05 · CVPR 2022 1 · Tao Feng, Mang Wang, Hangjie Yuan

Traditional object detectors are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will lead to catastrophic forgetting. Knowledge distillation is a…

Class-Incremental Object DetectionIncremental LearningKnowledge Distillationobject-detection+1

I3DOD: Towards Incremental 3D Object Detection via Prompting

2023-08-24 · Wenqi Liang, Gan Sun, Chenxi Liu, Jiahua Dong 외

3D object detection has achieved significant performance in many fields, e.g., robotics system, autonomous driving, and augmented reality. However, most existing methods could cause catastrophic forgetting of old classes…

3D Object DetectionAutonomous DrivingObjectobject-detection+2

Refined Response Distillation for Class-Incremental Player Detection

2023-05-01 · Liang Bai, Hangjie Yuan, Tao Feng, Hong Song 외

Detecting players from sports broadcast videos is essential for intelligent event analysis. However, existing methods assume fixed player categories, incapably accommodating the real-world scenarios where categories cont…

Knowledge Distillationobject-detectionObject Detection

Alleviating Catastrophic Forgetting of Incremental Object Detection via Within-Class and Between-Class Knowledge Distillation

2023-01-01 · ICCV 2023 1 · Mengxue Kang, Jinpeng Zhang, Jinming Zhang, Xiashuang Wang 외

Incremental object detection (IOD) task requires a model to learn continually from newly added data. However, directly fine-tuning a well-trained detection model on a new task will sharply decrease the performance on…

Knowledge Distillationobject-detectionObject Detection

Multi-Task Incremental Learning for Object Detection

2020-02-13 · Xialei Liu, Hao Yang, Avinash Ravichandran, Rahul Bhotika 외

Multi-task learns multiple tasks, while sharing knowledge and computation among them. However, it suffers from catastrophic forgetting of previous knowledge when learned incrementally without access to the old data. Most…

Incremental LearningObjectobject-detectionObject Detection