paper-with-me

홈 › Papers

Memory Gym: Towards Endless Tasks to Benchmark Memory Capabilities of Agents

2023-09-29 · Marco Pleines, Matthias Pallasch, Frank Zimmer, Mike Preuss

Memory Gym presents a suite of 2D partially observable environments, namely Mortar Mayhem, Mystery Path, and Searing Spotlights, designed to benchmark memory capabilities in decision-making agents. These environments, originally with finite tasks, are expanded into innovative, endless formats, mirroring the escalating challenges of cumulative memory games such as "I packed my bag". This progression in task design shifts the focus from merely assessing sample efficiency to also probing the levels of memory effectiveness in dynamic, prolonged scenarios. To address the gap in available memory-based Deep Reinforcement Learning baselines, we introduce an implementation within the open-source CleanRL library that integrates Transformer-XL (TrXL) with Proximal Policy Optimization. This approach utilizes TrXL as a form of episodic memory, employing a sliding window technique. Our comparative study between the Gated Recurrent Unit (GRU) and TrXL reveals varied performances across our finite and endless tasks. TrXL, on the finite environments, demonstrates superior effectiveness over GRU, but only when utilizing an auxiliary loss to reconstruct observations. Notably, GRU makes a remarkable resurgence in all endless tasks, consistently outperforming TrXL by significant margins. Website and Source Code: https://marcometer.github.io/jmlr_2024.github.io/

📄 PDF Abstract BibTeX arXiv:2309.17207

Code (1)

marcometer/endless-memory-gym 공식 구현

Tasks

Decision MakingDeep Reinforcement Learning

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Multi-Head Attention 설명 없음
Attention 설명 없음
Focus 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Variational Dropout Variational Dropout is a regularization technique based on dropout, but uses a variational inference grounded approach. In…

Similar Papers 제목 키워드 기반

Memory, Benchmark & Robots: A Benchmark for Solving Complex Tasks with Reinforcement Learning

2025-02-14 · Egor Cherepanov, Nikita Kachaev, Alexey K. Kovalev, Aleksandr I. Panov

Memory is crucial for enabling agents to tackle complex tasks with temporal and spatial dependencies. While many reinforcement learning (RL) algorithms incorporate memory, the field lacks a universal benchmark to assess …

Reinforcement Learning (RL)Skills Assessment

Evaluating Memory Structure in LLM Agents

2026-02-11 · Alina Shutova, Alexandra Olenina, Ivan Vinogradov, Anton Sinitsin arxiv

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it bec…

RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Design

2026-03-01 · Tianxing Chen, Yuran Wang, Mingleyang Li, Yan Qin 외 arxiv

Robotic manipulation policies have made rapid progress in recent years, yet most existing approaches give limited consideration to memory capabilities. Consequently, they struggle to solve tasks that require reasoning ov…

Alaya-EVOKE: From Linear-Scaling Supervision to Endless World

2026-08-13 · Yuanyang Yin, Gongxuan Wang, Yifan Zhan, Chuanhao Li 외 arxiv

Interactive world models must support persistent memory, responsive interaction, and long-horizon generation, yet these requirements place conflicting demands on the model. Maintaining history in the denoiser context or …

Minerva: A Programmable Memory Test Benchmark for Language Models

2025-02-05 · Menglin Xia, Victor Ruehle, Saravan Rajmohan, Reza Shokri

How effectively can LLM-based AI assistants utilize their memory (context) to perform various tasks? Traditional data benchmarks, which are often manually crafted, suffer from several limitations: they are static, suscep…