paper-with-me

홈 › Papers

Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents

2026-01-07 · Dehao Tao, Guoliang Ma, Yongfeng Huang, Minghu Jiang arxiv

Long-term human-agent dialogues are organized by topic continuity: adjacent turns often develop the same goal, plan, problem, or event, while related activities may recur across distant sessions. Yet many LLM agent memory systems first decompose histories into isolated turns or fixed-size chunks, then compensate through enrichment, consolidation, or retrieval mechanisms still tied to semantic proximity or fragment-level records. This weakens temporal and causal organization and biases memory access toward semantic proximity rather than task- or topic-level continuity. We introduce \emph{Membox}, a hierarchical memory architecture that instantiates topic continuity as an explicit organization layer for agent memory. Its \textbf{Topic Loom} incrementally organizes dialogue streams into boxes whose internal turns follow the same local topic, while its \textbf{Trace Weaver} links extracted events across boxes into macro-topic traces that recover recurring activities, goals, and factual developments across distant sessions. On LoCoMo, Topic-Loom-only retrieval improves over the best Mem0/A-MEM retrieval-depth setting by 13.00 F1 points (53.95 vs. 40.95), and trace-expanded retrieval further raises F1 to 55.28; with GPT-4o, trace-expanded retrieval reaches 59.71 F1. Additional DialSim results show the same gain from adding cross-box traces in multi-party dialogue. These results show that local topic-continuity organization and macro-topic trace expansion improve long-range memory beyond semantic retrieval over fragmented records.

📄 PDF Abstract BibTeX arXiv:2601.03785

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic Retrieval

Similar Papers 제목 키워드 기반

Contextual Memory Reweaving in Large Language Models Using Layered Latent State Reconstruction

2025-02-04 · Frederick Dillon, Gregor Halvorsen, Simon Tattershall, Magnus Rowntree 외

Memory retention challenges in deep neural architectures have ongoing limitations in the ability to process and recall extended contextual information. Token dependencies degrade as sequence length increases, leading to …

Computational EfficiencyText Generation

Don't Shoot The Breeze: Topic Continuity Model Using Nonlinear Naive Bayes With Attention

2026-02-10 · Shu-Ting Pi, Pradeep Bagavan, Yejia Li, Disha 외 arxiv

Utilizing Large Language Models (LLM) as chatbots in diverse business scenarios often presents the challenge of maintaining topic continuity. Abrupt shifts in topics can lead to poor user experiences and inefficient util…

Natural Language Understanding

UnweaveNet: Unweaving Activity Stories

2021-12-19 · CVPR 2022 1 · Will Price, Carl Vondrick, Dima Damen

Our lives can be seen as a complex weaving of activities; we switch from one activity to another, to maximise our achievements or in reaction to demands placed upon us. Observing a video of unscripted daily activities, w…

Annotation of anaphoric relations and topic continuity in Japanese conversation

2012-05-01 · LREC 2012 5 · Natsuko Nakagawa, Yasuharu Den

This paper proposes a basic scheme for annotating anaphoric relations in Japanese conversations. More specifically, we propose methods of (i) dividing discourse segments into meaningful units, (ii) identifying zero prono…

FabricGen: Microstructure-Aware Woven Fabric Generation

2026-03-07 · Yingjie Tang, Di Luo, Zixiong Wang, Xiaoli Ling 외 arxiv

Woven fabric materials are widely used in rendering applications, yet designing realistic examples typically involves multiple stages, requiring expertise in weaving principles and texture authoring. Recent advances have…