paper-with-me

홈 › Papers

SCM: Sleep-Consolidated Memory with Algorithmic Forgetting for Large Language Models

2026-04-22 · Saish Sachin Shinde arxiv

We present SCM (Sleep-Consolidated Memory), a research preview of a memory architecture for large language models that draws on neuroscientific principles to address a fundamental limitation in current systems: the absence of persistent, structured, and biologically plausible memory. Existing approaches rely on truncating context windows, growing vector databases without bound, or tiered storage systems that lack consolidation and forgetting mechanisms. SCM implements five core components inspired by human memory: a limited-capacity working memory, multi-dimensional importance tagging, offline sleep-stage consolidation with distinct NREM and REM phases, intentional value-based forgetting, and a computational self-model enabling introspection. Across a standardized benchmark suite of eight tests, the prototype achieves perfect recall accuracy over ten-turn conversations while reducing memory noise by 90.9% through adaptive forgetting. Memory search latency remains below one millisecond even with hundreds of stored concepts. This work establishes the architectural foundations for memory systems that consolidate, prioritize, and forget, offering a testable platform for advancing LLM memory research.

📄 PDF Abstract BibTeX arXiv:2604.20943

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Wake-Sleep Consolidated Learning

2023-12-06 · Amelia Sorrenti, Giovanni Bellitto, Federica Proietto Salanitri, Matteo Pennisi 외

We propose Wake-Sleep Consolidated Learning (WSCL), a learning strategy leveraging Complementary Learning System theory and the wake-sleep phases of the human brain to improve the performance of deep neural networks for …

Continual LearningHippocampus

FearNet: Brain-Inspired Model for Incremental Learning

2017-11-28 · ICLR 2018 1 · Ronald Kemker, Christopher Kanan

Incremental class learning involves sequentially learning classes in bursts of examples from the same class. This violates the assumptions that underlie methods for training standard deep neural networks, and will cause …

Audio ClassificationIncremental Learningmodel

Biologically inspired sleep algorithm for artificial neural networks

2019-08-01 · Giri P. Krishnan, Timothy Tadros, Ramyaa Ramyaa, Maxim Bazhenov

Sleep plays an important role in incremental learning and consolidation of memories in biological systems. Motivated by the processes that are known to be involved in sleep generation in biological networks, we developed…

Incremental LearningTransfer Learning

Learning to Forget: Sleep-Inspired Memory Consolidation for Resolving Proactive Interference in Large Language Models

2026-03-15 · Ying Xie arxiv

Large language models (LLMs) suffer from proactive interference (PI): outdated information in the context window disrupts retrieval of current values. This interference degrades retrieval accuracy log-linearly as stale a…

Prompt Engineering

Continual learning benefits from multiple sleep mechanisms: NREM, REM, and Synaptic Downscaling

2022-09-09 · Brian S. Robinson, Clare W. Lau, Alexander New, Shane M. Nichols 외

Learning new tasks and skills in succession without losing prior learning (i.e., catastrophic forgetting) is a computational challenge for both artificial and biological neural networks, yet artificial systems struggle t…

Continual Learningimage-classificationImage Classification