paper-with-me

Papers

Brain memory working. Optimal control behavior for improved Hopfield-like models

2023-05-11 · Franco Cardin, Alberto Lovison, Amos Maritan, Aram Megighian

Recent works have highlighted the need for a new dynamical paradigm in the modeling of brain function and evolution. Specifically, these models should incorporate non-constant and asymmetric synaptic weights \(T_{ij}\) in the neuron-neuron interaction matrix, moving beyond the classical Hopfield framework. Krotov and Hopfield proposed a non-constant yet symmetric model, resulting in a vector field that describes gradient-type dynamics, which includes a Lyapunov-like energy function. Firstly, we will outline the general conditions for generating a Hopfield-like vector field of gradient type, recovering the Krotov-Hopfield condition as a particular case. Secondly, we address the issue of symmetry, which we abandon for two key physiological reasons: (1) actual neural connections have a distinctly directional character (axons and dendrites), and (2) the gradient structure derived from symmetry forces the dynamics towards stationary points, leading to the recognition of every pattern. We propose a novel model that incorporates a set of limited but variable controls \(|\xi_{ij}|\leq K\), which are used to adjust an initially constant interaction matrix, \(T_{ij}=A_{ij}+\xi_{ij}\). Additionally, we introduce a reasonable controlled variational functional for optimization. This allows us to simulate three potential outcomes when a pattern is submitted to the learning system: (1) if the dynamics converges to an existing stationary point without activating controls, the system has \emph{recognized} an existing pattern; (2) if a new stationary point is reached through control activation, the system has \emph{learned} a new pattern; and (3) if the dynamics \emph{wanders} without reaching any stationary point, the system is unable to recognize or learn the submitted pattern. An additional feature (4) models the processes of \emph{forgetting and restoring} memory.

📄 PDF Abstract BibTeX arXiv:2305.14360

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

NON 설명 없음

Similar Papers 제목 키워드 기반

Brain state stability during working memory is explained by network control theory, modulated by dopamine D1/D2 receptor function, and diminished in schizophrenia

2019-06-21

Dynamical brain state transitions are critical for flexible working memory but the network mechanisms are incompletely understood. Here, we show that working memory entails brainwide switching between activity states. Th…

Temporal Dynamics of Cognitive Control

2008-12-01 · NeurIPS 2008 12 · Jeremy Reynolds, Michael C. Mozer

Cognitive control refers to the flexible deployment of memory and attention in response to task demands and current goals. Control is often studied experimentally by presenting sequences of stimuli, some demanding a resp…

Reinforcement Learning

Internal Feedback in Biological Control: Locality and System Level Synthesis

2021-09-24 · Jing Shuang Li

The presence of internal feedback pathways (IFPs) is a prevalent yet unexplained phenomenon in the brain. Motivated by experimental observations on 1) motor-related signals in visual areas, and 2) massively distributed p…

Modelling Working Memory using Deep Recurrent Reinforcement Learning

2019-09-11 · NeurIPS Workshop Neuro_AI 2019 12 · Pravish Sainath, Pierre Bellec, Guillaume Lajoie

In cognitive systems, the role of a working memory is crucial for visual reasoning and decision making. Tremendous progress has been made in understanding the mechanisms of the human/animal working memory, as well as in …

Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

ORGaNICs: A Theory of Working Memory in Brains and Machines

2018-03-16 · David J. Heeger, Wayne E. Mackey

Working memory is a cognitive process that is responsible for temporarily holding and manipulating information. Most of the empirical neuroscience research on working memory has focused on measuring sustained activity in…