paper-with-me

홈 › Papers

Forgetting as a Feature: Cognitive Alignment of Large Language Models

2025-12-28 · Alexandros Christoforos arxiv

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this behavior as a limitation, we reinterpret forgetting as a functional cognitive mechanism. Drawing inspiration from human memory dynamics, we model LLM inference as a probabilistic memory process governed by exponential decay. We introduce a benchmark suite that evaluates temporal reasoning, concept drift adaptation, and associative recall, enabling direct comparison between model behavior and human cognitive patterns. Our empirical results reveal that LLMs demonstrate forgetting rates analogous to human memory efficiency trade-offs between stability and adaptability. Building on these observations, we propose probabilistic memory prompting, a lightweight strategy that shapes evidence integration to mimic human-like memory decay, leading to improved long-horizon reasoning performance. Our findings position forgetting not as a failure mode, but as a principled mechanism for adaptive intelligence.

📄 PDF Abstract BibTeX arXiv:2601.09726

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

Beyond Sight: Towards Cognitive Alignment in LVLM via Enriched Visual Knowledge

2024-11-25 · CVPR 2025 1 · Yaqi Zhao, Yuanyang Yin, Lin Li, MingAn Lin 외

Does seeing always mean knowing? Large Vision-Language Models (LVLMs) integrate separately pre-trained vision and language components, often using CLIP-ViT as vision backbone. However, these models frequently encounter a…

Landmark RecognitionLarge Language Model

Adaptive Forgetting Curves for Spaced Repetition Language Learning

2020-04-23 · Ahmed Zaidi, Andrew Caines, Russell Moore, Paula Buttery 외

The forgetting curve has been extensively explored by psychologists, educationalists and cognitive scientists alike. In the context of Intelligent Tutoring Systems, modelling the forgetting curve for each user and knowle…

Parameter Alignment Mitigates Catastrophic Forgetting in Multilingual Expert Language Models

2026-05-29 · Sanchit Ahuja, Terra Blevins arxiv

While continual pretraining~(CPT) is a practical way to extend large language models to new languages, naïve finetuning on targeted data erodes existing capabilities through catastrophic forgetting. Organizing training a…

Reading ComprehensionContinual PretrainingLanguage AcquisitionGeneral Knowledge

Real Time Detection and Quantitative Analysis of Spurious Forgetting in Continual Learning

2025-12-02 · Weiwei Wang arxiv

Catastrophic forgetting remains a fundamental challenge in continual learning for large language models. Recent work revealed that performance degradation may stem from spurious forgetting caused by task alignment disrup…

Continual Learning

MetaGDPO: Alleviating Catastrophic Forgetting with Metacognitive Knowledge through Group Direct Preference Optimization

2025-11-15 · Lanxue Zhang, Yuqiang Xie, Fang Fang, Fanglong Dong 외 arxiv

Large Language Models demonstrate strong reasoning capabilities, which can be effectively compressed into smaller models. However, existing datasets and fine-tuning approaches still face challenges that lead to catastrop…