Forgetting in order to Remember Better
In human memory, forgetting occur rapidly after the remembering and the rate of forgetting slowed down as time went. This is so-called the Ebbinghaus forgetting curve. There are many explanations of how this curve occur based on the properties of the brains. In this article, we use a simple mathematical model to explain the mechanism of forgetting based on rearrangement inequality and get a general formalism for short-term and long-term memory and use it to fit the Ebbinghaus forgetting curve. We also find out that forgetting is not a flaw, instead it is help to improve the efficiency of remembering when human confront different situations by reducing the interference of information and reducing the number of retrievals. Furthurmove, we find that the interference of informations limits the capacity of human memory, which is the "magic number seven".
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Learning by Active Forgetting for Neural Networks
Remembering and forgetting mechanisms are two sides of the same coin in a human learning-memory system. Inspired by human brain memory mechanisms, modern machine learning systems have been working to endow machine with l…
Lifelong learningResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting
We propose ResRep, a novel method for lossless channel pruning (a.k.a. filter pruning), which slims down a CNN by reducing the width (number of output channels) of convolutional layers. Inspired by the neurobiology resea…
Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping
Catastrophic forgetting in neural networks is a significant problem for continual learning. A majority of the current methods replay previous data during training, which violates the constraints of an ideal continual lea…
Continual LearningRemembering for the Right Reasons: Explanations Reduce Catastrophic Forgetting
The goal of continual learning (CL) is to learn a sequence of tasks without suffering from the phenomenon of catastrophic forgetting. Previous work has shown that leveraging memory in the form of a replay buffer can redu…
Continual LearningOnline Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two recent continual-learning scenarios have opened new avenues of research. In meta-continu…
Continual LearningMeta-Learning