paper-with-me

홈 › Papers

"What" x "When" working memory representations using Laplace Neural Manifolds

2024-09-30 · Aakash Sarkar, Chenyu Wang, Shangfu Zuo, Marc W. Howard

Working memory $\unicode{x2013}$ the ability to remember recent events as they recede continuously into the past $\unicode{x2013}$ requires the ability to represent any stimulus at any time delay. This property requires neurons coding working memory to show mixed selectivity, with conjunctive receptive fields (RFs) for stimuli and time, forming a representation of 'what' $\times$ 'when'. We study the properties of such a working memory in simple experiments where a single stimulus must be remembered for a short time. The requirement of conjunctive receptive fields allows the covariance matrix of the network to decouple neatly, allowing an understanding of the low-dimensional dynamics of the population. Different choices of temporal basis functions lead to qualitatively different dynamics. We study a specific choice $\unicode{x2013}$ a Laplace space with exponential basis functions for time coupled to an "Inverse Laplace" space with circumscribed basis functions in time. We refer to this choice with basis functions that evenly tile log time as a Laplace Neural Manifold. Despite the fact that they are related to one another by a linear projection, the Laplace population shows a stable stimulus-specific subspace whereas the Inverse Laplace population shows rotational dynamics. The growth of the rank of the covariance matrix with time depends on the density of the temporal basis set; logarithmic tiling shows good agreement with data. We sketch a continuous attractor CANN that constructs a Laplace Neural Manifold. The attractor in the Laplace space appears as an edge; the attractor for the inverse space appears as a bump. This work provides a map for going from more abstract cognitive models of WM to circuit-level implementation using continuous attractor neural networks, and places constraints on the types of neural dynamics that support working memory.

📄 PDF Abstract BibTeX arXiv:2409.20484

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Simple Reservoir Model of Working Memory with Real Values

2018-06-18 · Anthony Strock, Nicolas Rougier, Xavier Hinaut

The prefrontal cortex is known to be involved in many high-level cognitive functions, in particular, working memory. Here, we study to what extent a group of randomly connected units (namely an Echo State Network, ESN) c…

Hierarchical Working Memory and a New Magic Number

2024-08-14 · Weishun Zhong, Mikhail Katkov, Misha Tsodyks

The extremely limited working memory span, typically around four items, contrasts sharply with our everyday experience of processing much larger streams of sensory information concurrently. This disparity suggests that w…

Chunking

Memex(RL): Scaling Long-Horizon LLM Agents via Indexed Experience Memory

2026-03-04 · Zhenting Wang, Huancheng Chen, Jiayun Wang, Wei Wei arxiv

Large language model (LLM) agents are fundamentally bottlenecked by finite context windows on long-horizon tasks. As trajectories grow, retaining tool outputs and intermediate reasoning in-context quickly becomes infeasi…

Reinforcement Learning

In-context superposition: human-like working memory interference in large language models

2026-04-01 · Hua-Dong Xiong, Li Ji-An, Jiaqi Huang, Robert C. Wilson 외 arxiv

Intelligent systems must maintain and manipulate task-relevant information online to adapt to dynamic environments. This capacity, known as working memory, is fundamental to human reasoning. Yet, human working memory is …

Gating Mechanisms Underlying Sequence-to-Sequence Working Memory

2021-09-29 · Ian D Jordan, Piotr A Sokol, Il Memming Park

Working memory is the process by which a system temporarily stores information across a necessary duration. Memory retention and manipulation of discrete sequences are fundamental building blocks for the underlying compu…