paper-with-me

홈 › Papers

Interactive Memory Learning for Long-Term Conversations

2026-09-15 · Cai Ke, Jiangyue Yan, Han Zhang, Xin Liu, Zike Yuan, Yue Yu, Hui Wang, Ruifeng Xu arxiv

Recent advancements in large language models have significantly enhanced the capabilities of agents in modeling long-term conversations. Despite these successes, existing approaches typically adopt a static heuristic paradigm, where information is passively archived without adaptive memory valuation. Consequently, these methods fail to self-evolve or align their memory management with evolving user needs. To address this, we propose ICML (InteraCtive Memory Learning), a multi-agent framework that transforms the memory mechanism from a passive archive into a learnable, interactive memory policy. Specifically, we first employ a session synthesis pipeline to generate expert data, facilitating rapid test-time adaptation in unseen scenarios. Building on this, ICML utilizes an online reinforcement learning mechanism where a Planner agent selectively encodes high-value information and a Trigger agent dynamically retrieves it to optimize response quality, whereby the two agents co-evolve through continuous interaction feedback. Crucially, both agents are synchronized through a delayed reward mechanism that propagates future feedback back to earlier storage decisions, ensuring memory policies are precisely aligned with user expectations. Experimental results demonstrate that ICML significantly outperforms strong baselines, exhibiting the unique capability to continuously improve response quality as interactions accumulate.

📄 PDF Abstract BibTeX arXiv:2609.17088

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningTest-time Adaptation

Similar Papers 제목 키워드 기반

Keep Me Updated! Memory Management in Long-term Conversations

2022-10-17 · Sanghwan Bae, Donghyun Kwak, Soyoung Kang, Min Young Lee 외

Remembering important information from the past and continuing to talk about it in the present are crucial in long-term conversations. However, previous literature does not deal with cases where the memorized information…

Management

AgenticAI-DialogGen: Topic-Guided Conversation Generation for Fine-Tuning and Evaluating Short- and Long-Term Memories of LLMs

2026-04-14 · Manoj Madushanka Perera, Adnan Mahmood, Kasun Eranda Wijethilake, Quan Z. Sheng arxiv

Recent advancements in Large Language Models (LLMs) have improved their ability to process extended conversational contexts, yet fine-tuning and evaluating short- and long-term memories remain difficult due to the absenc…

Knowledge Graphs

From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents

2026-04-21 · Md Nayem Uddin, Kumar Shubham, Eduardo Blanco, Chitta Baral 외 arxiv

Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory eval…

Memoria: A Scalable Agentic Memory Framework for Personalized Conversational AI

2025-12-14 · Samarth Sarin, Lovepreet Singh, Bhaskarjit Sarmah, Dhagash Mehta arxiv

Agentic memory is emerging as a key enabler for large language models (LLM) to maintain continuity, personalization, and long-term context in extended user interactions, critical capabilities for deploying LLMs as truly …

AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversations

2026-03-02 · Cheng Jiayang, Dongyu Ru, Lin Qiu, Yiyang Li 외 arxiv

Long-horizon interactions between users and LLM-based assistants necessitate effective memory management, yet current approaches face challenges in training and evaluation of memory. Existing memory benchmarks rely on st…