paper-with-me

홈 › Papers

ContextWeaver: Selective and Dependency-Structured Memory Construction for LLM Agents

2026-04-24 · Yating Wu, Yuhao Zhang, Sayan Ghosh, Sourya Basu, Anoop Deoras, Jun Huan, Gaurav Gupta arxiv

Large language model (LLM) agents often struggle in long-context interactions. As the agent accumulates more interaction history, context management approaches such as sliding window and prompt compression may omit earlier structured information that later steps rely on. Recent retrieval-based memory systems surface relevant content but still overlook the causal and logical structure needed for multi-step reasoning. We introduce ContextWeaver, a selective and dependency-structured memory framework that organizes an agent's interaction trace into a graph of reasoning steps and selects the relevant context for future actions. Unlike prior context management approaches, ContextWeaver supports: (1) dependency-based construction and traversal that link each step to the earlier steps it relies on; (2) compact dependency summarization that condenses root-to-step reasoning paths into reusable units; and (3) a lightweight validation layer that incorporates execution feedback. On the SWE-Bench Verified and Lite benchmarks, ContextWeaver improves performance over a sliding-window baseline in pass@1, while reducing reasoning steps and token usage. Our observations suggest that modeling logical dependencies provides a stable and scalable memory mechanism for LLM agents that use tools.

📄 PDF Abstract BibTeX arXiv:2604.23069

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation

2024-03-27 · Xilin Jiang, Cong Han, Nima Mesgarani

Transformers have been the most successful architecture for various speech modeling tasks, including speech separation. However, the self-attention mechanism in transformers with quadratic complexity is inefficient in co…

MambaSpeech SeparationState Space Models

A-MBER: Affective Memory Benchmark for Emotion Recognition

2026-04-08 · Deliang Wen, Ke Sun, Yu Wang arxiv

AI assistants that interact with users over time need to interpret the user's current emotional state in order to respond appropriately and personally. However, this capability remains insufficiently evaluated. Existing …

Emotion Recognition

SA-DiffuSeq: Addressing Computational and Scalability Challenges in Long-Document Generation with Sparse Attention

2025-12-23 · Alexandros Christoforos, Chadbourne Davis arxiv

Diffusion based approaches to long form text generation suffer from prohibitive computational cost and memory overhead as sequence length increases. We introduce SA-DiffuSeq, a diffusion framework that integrates sparse …

Code GenerationText Generation

MRMS: A Multi-Resolution Memory Substrate for Long-Lived AI Agents

2026-07-06 · Jizhizi Li, Amy Shi-Nash arxiv

Long-lived AI agents require continuity across interactions, but continuity cannot be obtained by simply extending the prompt window. An agent must preserve useful prior experience, retrieve it selectively, distinguish p…

PREPING: Building Agent Memory without Tasks

2026-05-11 · Yumin Choi, Sangwoo Park, Minki Kang, Jinheon Baek 외 arxiv

Agent memory is typically constructed either offline from curated demonstrations or online from post-deployment interactions. However, regardless of how it is built, an agent faces a cold-start gap when first introduced …