TIDo: Source-free Task Incremental Learning in Non-stationary Environments
This work presents an incremental learning approach for autonomous agents to learn new tasks in a non-stationary environment. Updating a DNN model-based agent to learn new target tasks requires us to store past training data and needs a large labeled target task dataset. Few-shot task incremental learning methods overcome the limitation of labeled target datasets by adapting trained models to learn private target classes using a few labeled representatives and a large unlabeled target dataset. However, the methods assume that the source and target tasks are stationary. We propose a one-shot task incremental learning approach that can adapt to non-stationary source and target tasks. Our approach minimizes adversarial discrepancy between the model's feature space and incoming incremental data to learn an updated hypothesis. We also use distillation loss to reduce catastrophic forgetting of previously learned tasks. Finally, we use Gaussian prototypes to generate exemplar instances eliminating the need to store past training data. Unlike current work in task incremental learning, our model can learn both source and target task updates incrementally. We evaluate our method on various problem settings for incremental object detection and disease prediction model update. We evaluate our approach by measuring the performance of shared class and target private class prediction. Our results show that our approach achieved improved performance compared to existing state-of-the-art task incremental learning methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Disease PredictionIncremental Learningobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Adversarial Learning Networks: Source-free Unsupervised Domain Incremental Learning
This work presents an approach for incrementally updating deep neural network (DNN) models in a non-stationary environment. DNN models are sensitive to changes in input data distribution, which limits their application t…
Continual LearningDisease PredictionDomain AdaptationEnsemble Learning+3R\'esumer automatiquement en ligne : d\'emonstration d'un service web de r\'esum\'e multidocument (Summarizing Automatically Online : We propose a demonstration of an automatic multidocument summarization web service)
r automatiquement en ligne : d{\'e}monstration d{'}un service web de r{\'e}sum{\'e} multidocument Valentin Nyzam Nathan Gatto Aur{\'e}lien Bossard LIASD, Universit{\'e} Paris 8 - IUT de Montreuil, 140 rue de la Nouvelle …
A Classifier-Free Incremental Learning Framework for Scalable Medical Image Segmentation
Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However…
Contrastive LearningImage SegmentationIncremental LearningKnowledge Distillation+3Multidomain Pretrained Language Models for Green NLP
When tackling a task in a given domain, it has been shown that adapting a model to the domain using raw text data before training on the supervised task improves performance versus solely training on the task. The downsi…
Domain AdaptationEvaluating and Characterizing Incremental Learning from Non-Stationary Data
Incremental learning from non-stationary data poses special challenges to the field of machine learning. Although new algorithms have been developed for this, assessment of results and comparison of behaviors are still o…
Incremental Learning