paper-with-me

홈 › Papers

Dynamic memory to alleviate catastrophic forgetting in continuous learning settings

2020-07-06 · Johannes Hofmanninger, Matthias Perkonigg, James A. Brink, Oleg Pianykh, Christian Herold, Georg Langs

In medical imaging, technical progress or changes in diagnostic procedures lead to a continuous change in image appearance. Scanner manufacturer, reconstruction kernel, dose, other protocol specific settings or administering of contrast agents are examples that influence image content independent of the scanned biology. Such domain and task shifts limit the applicability of machine learning algorithms in the clinical routine by rendering models obsolete over time. Here, we address the problem of data shifts in a continuous learning scenario by adapting a model to unseen variations in the source domain while counteracting catastrophic forgetting effects. Our method uses a dynamic memory to facilitate rehearsal of a diverse training data subset to mitigate forgetting. We evaluated our approach on routine clinical CT data obtained with two different scanner protocols and synthetic classification tasks. Experiments show that dynamic memory counters catastrophic forgetting in a setting with multiple data shifts without the necessity for explicit knowledge about when these shifts occur.

📄 PDF Abstract BibTeX arXiv:2007.02639

Code (0)

등록된 구현이 없습니다.

Tasks

Diagnostic

Similar Papers 제목 키워드 기반

Improving Continual Relation Extraction through Prototypical Contrastive Learning

2022-10-10 · COLING 2022 10 · Chengwei Hu, Deqing Yang, Haoliang Jin, Zhen Chen 외

Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In order to alleviate this…

Continual Relation ExtractionContrastive LearningRelationRelation Extraction

Representation Memorization for Fast Learning New Knowledge without Forgetting

2021-08-28 · Fei Mi, Tao Lin, Boi Faltings

The ability to quickly learn new knowledge (e.g. new classes or data distributions) is a big step towards human-level intelligence. In this paper, we consider scenarios that require learning new classes or data distribut…

image-classificationImage ClassificationLanguage ModelingLanguage Modelling+1

Consistent Representation Learning for Continual Relation Extraction

2022-03-05 · Findings (ACL) 2022 5 · Kang Zhao, Hua Xu, Jiangong Yang, Kai Gao

Continual relation extraction (CRE) aims to continuously train a model on data with new relations while avoiding forgetting old ones. Some previous work has proved that storing a few typical samples of old relations and …

Continual Relation ExtractionContrastive LearningKnowledge DistillationRelation+2

Memory Augmented Neural Model for Incremental Session-based Recommendation

2020-04-28 · Fei Mi, Boi Faltings

Increasing concerns with privacy have stimulated interests in Session-based Recommendation (SR) using no personal data other than what is observed in the current browser session. Existing methods are evaluated in static …

Session-Based Recommendations

KASAM: Spline Additive Models for Function Approximation

2022-05-12 · Heinrich van Deventer, Pieter Janse van Rensburg, Anna Bosman

Neural networks have been criticised for their inability to perform continual learning due to catastrophic forgetting and rapid unlearning of a past concept when a new concept is introduced. Catastrophic forgetting can b…

Additive modelsContinual Learning