paper-with-me

Papers

Learning to Recover from Failures using Memory

2021-01-01 · Tao Chen, Pulkit Agrawal

Learning from past mistakes is a quintessential aspect of intelligence. In sequential decision-making, existing meta-learning methods that learn a learning algorithm utilize experience from only a few previous episodes to adapt their policy to new environments and tasks. Such methods must learn to correct their mistakes from highly-correlated sequences of states and actions generated by the same policy's consequent roll-outs during training. Learning from correlated data is known to be problematic and can significantly impact the quality of the learned correction mechanism. We show that this problem can be mitigated by augmenting current systems with an external memory bank that stores a larger and more diverse set of past experiences. Detailed experiments demonstrate that our method outperforms existing meta-learning algorithms on a suite of challenging tasks from raw visual observations.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingMeta-LearningSequential Decision Making

Similar Papers 제목 키워드 기반

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint

2026-07-02 · Haotian Xie, Junlin Chen, Mingkai Zheng, Lishan Yang 외 arxiv

State-of-the-art large language model (LLM) training takes tens of thousands of graphics processing units (GPUs) for months and encounters failures across the software and hardware stack. Existing fault-tolerance mechani…

VLM-DEWM: Dynamic External World Model for Verifiable and Resilient Vision-Language Planning in Manufacturing

2026-02-17 · Guoqin Tang, Qingxuan Jia, Gang Chen, Tong Li 외 arxiv

Vision-language model (VLM) shows promise for high-level planning in smart manufacturing, yet their deployment in dynamic workcells faces two critical challenges: (1) stateless operation, they cannot persistently track o…

Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents

2026-06-12 · Seoyoung Choi, Minseok Ko, Hyunseok Lee, Kunwoong Kim 외 arxiv

Graphical User Interface (GUI) agents are increasingly used to automate complex computer tasks across applications, websites, and operating systems. To improve their reliability, recent work has introduced experiential m…

Control-Plane Placement Shapes Forgetting: An Architectural Study of Agent Memory Across Thirteen System Configurations

2026-06-14 · Dongxu Yang arxiv

Where an LLM sits in an agent memory pipeline -- between the recall plane that retrieves stored facts (extensively benchmarked) and the control plane that mutates them via supersede, release, purge (largely untested) -- …

Where LLM Agents Fail and How They can Learn From Failures

2025-09-29 · Kunlun Zhu, Zijia Liu, Bingxuan Li, Muxin Tian 외 arxiv

Large Language Model (LLM) agents, which integrate planning, memory, reflection, and tool-use modules, have shown promise in solving complex, multi-step tasks. Yet their sophisticated architectures amplify vulnerability …