paper-with-me

Papers

Biological key-value memory networks

2021-12-01 · NeurIPS 2021 12 · Danil Tyulmankov, Ching Fang, Annapurna Vadaparty, Guangyu Robert Yang

In neuroscience, classical Hopfield networks are the standard biologically plausible model of long-term memory, relying on Hebbian plasticity for storage and attractor dynamics for recall. In contrast, memory-augmented neural networks in machine learning commonly use a key-value mechanism to store and read out memories in a single step. Such augmented networks achieve impressive feats of memory compared to traditional variants, yet their biological relevance is unclear. We propose an implementation of basic key-value memory that stores inputs using a combination of biologically plausible three-factor plasticity rules. The same rules are recovered when network parameters are meta-learned. Our network performs on par with classical Hopfield networks on autoassociative memory tasks and can be naturally extended to continual recall, heteroassociative memory, and sequence learning. Our results suggest a compelling alternative to the classical Hopfield network as a model of biological long-term memory.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Biological learning in key-value memory networks

2021-10-26 · NeurIPS 2021 12 · Danil Tyulmankov, Ching Fang, Annapurna Vadaparty, Guangyu Robert Yang

In neuroscience, classical Hopfield networks are the standard biologically plausible model of long-term memory, relying on Hebbian plasticity for storage and attractor dynamics for recall. In contrast, memory-augmented n…

Key-value memory in the brain

2025-01-06 · Samuel J. Gershman, Ila Fiete, Kazuki Irie

Classical models of memory in psychology and neuroscience rely on similarity-based retrieval of stored patterns, where similarity is a function of retrieval cues and the stored patterns. While parsimonious, these models …

Retrieval

Introducing Memory and Association Mechanism into a Biologically Inspired Visual Model

2013-07-04 · Qiao Hong, Li Yinlin, Tang Tang, Wang Peng

A famous biologically inspired hierarchical model firstly proposed by Riesenhuber and Poggio has been successfully applied to multiple visual recognition tasks. The model is able to achieve a set of position- and scale-t…

Object RecognitionPosition

Kernel Memory Networks: A Unifying Framework for Memory Modeling

2022-08-19 · Georgios Iatropoulos, Johanni Brea, Wulfram Gerstner

We consider the problem of training a neural network to store a set of patterns with maximal noise robustness. A solution, in terms of optimal weights and state update rules, is derived by training each individual neuron…

The Whale That Outswam Evolution: Swarm Intelligence Maximises Memory in Connectome Reservoirs

2026-06-05 · Anmol Guragain, Savvas Kakalis, Juan Ignacio Godino-Llorente arxiv

Reservoir computing exploits the fixed dynamics of a recurrent network for temporal processing, requiring only a trained linear readout. Biological neural connectomes, shaped by millions of years of evolution, may encode…