paper-with-me

홈 › Papers

A Survey on the Memory Mechanism of Large Language Model based Agents

2024-04-21 · Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, Ji-Rong Wen

Large language model (LLM) based agents have recently attracted much attention from the research and industry communities. Compared with original LLMs, LLM-based agents are featured in their self-evolving capability, which is the basis for solving real-world problems that need long-term and complex agent-environment interactions. The key component to support agent-environment interactions is the memory of the agents. While previous studies have proposed many promising memory mechanisms, they are scattered in different papers, and there lacks a systematical review to summarize and compare these works from a holistic perspective, failing to abstract common and effective designing patterns for inspiring future studies. To bridge this gap, in this paper, we propose a comprehensive survey on the memory mechanism of LLM-based agents. In specific, we first discuss ''what is'' and ''why do we need'' the memory in LLM-based agents. Then, we systematically review previous studies on how to design and evaluate the memory module. In addition, we also present many agent applications, where the memory module plays an important role. At last, we analyze the limitations of existing work and show important future directions. To keep up with the latest advances in this field, we create a repository at \url{https://github.com/nuster1128/LLM_Agent_Memory_Survey}.

📄 PDF Abstract BibTeX arXiv:2404.13501

Code (1)

nuster1128/llm_agent_memory_survey 공식 구현

Tasks

Language ModelingLanguage ModellingLarge Language Model

Similar Papers 제목 키워드 기반

From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms

2026-05-07 · Jinghao Luo, Yuchen Tian, Chuxue Cao, Ziyang Luo 외 arxiv

Large Language Model (LLM)-based agents have fundamentally reshaped artificial intelligence by integrating external tools and planning capabilities. While memory mechanisms have emerged as the architectural cornerstone o…

Continual Learning

Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers

2026-03-08 · Pengfei Du arxiv

Large language model (LLM) agents increasingly operate in settings where a single context window is far too small to capture what has happened, what was learned, and what should not be repeated. Memory -- the ability to …

Rethinking Memory Mechanisms of Foundation Agents in the Second Half: A Survey

2026-01-14 · Wei-Chieh Huang, Weizhi Zhang, Yueqing Liang, Yuanchen Bei 외 arxiv

The research of artificial intelligence is undergoing a paradigm shift from prioritizing model innovations over benchmark scores towards emphasizing problem definition and rigorous real-world evaluation. As the field ent…

Agents That Know Too Much: A Data-Centric Survey of Privacy in LLM Agents

2026-06-25 · Nada Lahjouji, Ashwin Gerard Colaco arxiv

Large language model agents increasingly query databases, search document collections, call external APIs, remember past interactions, and act on a user's behalf. As they move from answering questions to operating over s…

Rethinking Memory in AI: Taxonomy, Operations, Topics, and Future Directions

2025-05-01 · Yiming Du, WenYu Huang, Danna Zheng, Zhaowei Wang 외

Memory is a fundamental component of AI systems, underpinning large language models (LLMs) based agents. While prior surveys have focused on memory applications with LLMs, they often overlook the atomic operations that u…

Survey