paper-with-me

홈 › Papers

RECALL: Rehearsal-free Continual Learning for Object Classification

2022-09-29 · Markus Knauer, Maximilian Denninger, Rudolph Triebel

Convolutional neural networks show remarkable results in classification but struggle with learning new things on the fly. We present a novel rehearsal-free approach, where a deep neural network is continually learning new unseen object categories without saving any data of prior sequences. Our approach is called RECALL, as the network recalls categories by calculating logits for old categories before training new ones. These are then used during training to avoid changing the old categories. For each new sequence, a new head is added to accommodate the new categories. To mitigate forgetting, we present a regularization strategy where we replace the classification with a regression. Moreover, for the known categories, we propose a Mahalanobis loss that includes the variances to account for the changing densities between known and unknown categories. Finally, we present a novel dataset for continual learning, especially suited for object recognition on a mobile robot (HOWS-CL-25), including 150,795 synthetic images of 25 household object categories. Our approach RECALL outperforms the current state of the art on CORe50 and iCIFAR-100 and reaches the best performance on HOWS-CL-25.

📄 PDF Abstract BibTeX arXiv:2209.14774

Code (1)

dlr-rm/recall 공식 구현 tf

Tasks

ClassificationContinual LearningObjectObject Recognition

Similar Papers 제목 키워드 기반

Rehearsal-Free Continual Learning over Small Non-I.I.D. Batches

2019-07-08 · Vincenzo Lomonaco, Davide Maltoni, Lorenzo Pellegrini

Robotic vision is a field where continual learning can play a significant role. An embodied agent operating in a complex environment subject to frequent and unpredictable changes is required to learn and adapt continuous…

class-incremental learningClass Incremental LearningContinual LearningObject Recognition

Rehearsal-Free Modular and Compositional Continual Learning for Language Models

2024-03-31 · Mingyang Wang, Heike Adel, Lukas Lange, Jannik Strötgen 외

Continual learning aims at incrementally acquiring new knowledge while not forgetting existing knowledge. To overcome catastrophic forgetting, methods are either rehearsal-based, i.e., store data examples from previous t…

Continual LearningTransfer Learning

A Closer Look at Rehearsal-Free Continual Learning

2022-03-31 · James Seale Smith, Junjiao Tian, Shaunak Halbe, Yen-Chang Hsu 외

Continual learning is a setting where machine learning models learn novel concepts from continuously shifting training data, while simultaneously avoiding degradation of knowledge on previously seen classes which may dis…

Continual LearningKnowledge DistillationL2 RegularizationNovel Concepts

Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learning

2023-07-10 · Gaurav Bagwe, Xiaoyong Yuan, Miao Pan, Lan Zhang

Federated continual learning (FCL) learns incremental tasks over time from confidential datasets distributed across clients. This paper focuses on rehearsal-free FCL, which has severe forgetting issues when learning new …

Continual LearningPrompt Learning

DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning

2022-04-10 · Zifeng Wang, Zizhao Zhang, Sayna Ebrahimi, Ruoxi Sun 외

Continual learning aims to enable a single model to learn a sequence of tasks without catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store past pristine examples for experience repl…

Continual Learning