paper-with-me

홈 › Papers

Two-Level Residual Distillation based Triple Network for Incremental Object Detection

2020-07-27 · Dongbao Yang, Yu Zhou, Dayan Wu, Can Ma, Fei Yang, Weiping Wang

Modern object detection methods based on convolutional neural network suffer from severe catastrophic forgetting in learning new classes without original data. Due to time consumption, storage burden and privacy of old data, it is inadvisable to train the model from scratch with both old and new data when new object classes emerge after the model trained. In this paper, we propose a novel incremental object detector based on Faster R-CNN to continuously learn from new object classes without using old data. It is a triple network where an old model and a residual model as assistants for helping the incremental model learning on new classes without forgetting the previous learned knowledge. To better maintain the discrimination of features between old and new classes, the residual model is jointly trained on new classes in the incremental learning procedure. In addition, a corresponding distillation scheme is designed to guide the training process, which consists of a two-level residual distillation loss and a joint classification distillation loss. Extensive experiments on VOC2007 and COCO are conducted, and the results demonstrate that the proposed method can effectively learn to incrementally detect objects of new classes, and the problem of catastrophic forgetting is mitigated in this context.

📄 PDF Abstract BibTeX arXiv:2007.13428

Code (0)

등록된 구현이 없습니다.

Tasks

Incremental LearningObjectobject-detectionObject DetectionVocal Bursts Valence Prediction

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

Towards Continual Knowledge Graph Embedding via Incremental Distillation

2024-05-07 · Jiajun Liu, Wenjun Ke, Peng Wang, Ziyu Shang 외

Traditional knowledge graph embedding (KGE) methods typically require preserving the entire knowledge graph (KG) with significant training costs when new knowledge emerges. To address this issue, the continual knowledge …

Graph EmbeddingKnowledge Graph Embedding

Response-based Distillation for Incremental Object Detection

2021-10-26 · Tao Feng, Mang Wang

Traditional object detection are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting. Knowledge distillation is …

Incremental LearningKnowledge DistillationObjectobject-detection+2

Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detection

2024-01-11 · Weibo Jiang, Weihong Ren, Jiandong Tian, Liangqiong Qu 외

Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which aims to predict the HOI triplet in the form of <human, object, action>. Existing methods mainly extract multi-modal features (e.g.…

Human-Object Interaction DetectionKnowledge DistillationObjectScene Understanding+1

Balanced Residual Distillation Learning for 3D Point Cloud Class-Incremental Semantic Segmentation

2024-08-02 · Yuanzhi Su, Siyuan Chen, Yuan-Gen Wang

Class-incremental learning (CIL) enables continuous learning of new classes while mitigating catastrophic forgetting of old ones. For the performance breakthrough of CIL, it is essential yet challenging to effectively re…

class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationIncremental Learning+2

Residual SODAP: Residual Self-Organizing Domain-Adaptive Prompting with Structural Knowledge Preservation for Continual Learning

2026-03-13 · Gyutae Oh, Jungwoo Bae, Jitae Shin arxiv

Continual learning (CL) suffers from catastrophic forgetting, which is exacerbated in domain-incremental learning (DIL) where task identifiers are unavailable and storing past data is infeasible. While prompt-based CL (P…

Incremental LearningContinual Learning