paper-with-me

홈 › Papers

Task Memory Engine: Spatial Memory for Robust Multi-Step LLM Agents

2025-05-26 · Ye Ye

Large Language Models (LLMs) falter in multi-step interactions -- often hallucinating, repeating actions, or misinterpreting user corrections -- due to reliance on linear, unstructured context. This fragility stems from the lack of persistent memory to track evolving goals and task dependencies, undermining trust in autonomous agents. We introduce the Task Memory Engine (TME), a modular memory controller that transforms existing LLMs into robust, revision-aware agents without fine-tuning. TME implements a spatial memory framework that replaces flat context with graph-based structures to support consistent, multi-turn reasoning. Departing from linear concatenation and ReAct-style prompting, TME builds a dynamic task graph -- either a tree or directed acyclic graph (DAG) -- to map user inputs to subtasks, align them with prior context, and enable dependency-tracked revisions. Its Task Representation and Intent Management (TRIM) component models task semantics and user intent to ensure accurate interpretation. Across four multi-turn scenarios-trip planning, cooking, meeting scheduling, and shopping cart editing -- TME eliminates 100% of hallucinations and misinterpretations in three tasks, and reduces hallucinations by 66.7% and misinterpretations by 83.3% across 27 user turns, outperforming ReAct. TME's modular design supports plug-and-play deployment and domain-specific customization, adaptable to both personal assistants and enterprise automation. We release TME's codebase, benchmarks, and components as open-source resources, enabling researchers to develop reliable LLM agents. TME's scalable architecture addresses a critical gap in agent performance across complex, interactive settings.

📄 PDF Abstract BibTeX arXiv:2505.19436

Code (1)

biubiutomato/tme-agent 공식 구현

Tasks

Scheduling

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planning

2026-03-12 · Xiaoyu Ma, Lianyu Hu, Wenbing Tang, Zixuan Hu 외 arxiv

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most …

Prompt EngineeringKnowledge Graphs

3D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTS

2026-04-13 · Bronislav Sidik, Dror Mizrahi arxiv

We present 3D-Anchored Lookahead Planning (3D-ALP), a System 2 reasoning engine for robotic manipulation that combines Monte Carlo Tree Search (MCTS) with a 3D-consistent world model as the rollout oracle. Unlike reactiv…

LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video

2026-06-04 · Shiqiang Lang, Jing Liu, Haoyang He, Peiwen Sun 외 arxiv

Multimodal Large Language Models (MLLMs) have advanced image and video understanding and can increasingly handle longer visual inputs. Long-horizon tasks such as autonomous driving and robotic navigation require more tha…

Autonomous DrivingSpatial Reasoning

Task Memory Engine (TME): A Structured Memory Framework with Graph-Aware Extensions for Multi-Step LLM Agent Tasks

2025-04-11 · Ye Ye

Large Language Models (LLMs) are increasingly used as autonomous agents for multi-step tasks. However, most existing frameworks fail to maintain a structured understanding of the task state, often relying on linear promp…

3DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Model

2025-05-28 · WenBo Hu, Yining Hong, Yanjun Wang, Leison Gao 외

Humans excel at performing complex tasks by leveraging long-term memory across temporal and spatial experiences. In contrast, current Large Language Models (LLMs) struggle to effectively plan and act in dynamic, multi-ro…

Language ModelingLanguage ModellingLarge Language ModelQuestion Answering