Now I Remember! Episodic Memory For Reinforcement Learning

2018-01-01 · ICLR 2018 1 · Ricky Loynd, Matthew Hausknecht, Lihong Li, Li Deng

Humans rely on episodic memory constantly, in remembering the name of someone they met 10 minutes ago, the plot of a movie as it unfolds, or where they parked the car. Endowing reinforcement learning agents with episodic memory is a key step on the path toward replicating human-like general intelligence. We analyze why standard RL agents lack episodic memory today, and why existing RL tasks don't require it. We design a new form of external memory called Masked Experience Memory, or MEM, modeled after key features of human episodic memory. To evaluate episodic memory we define an RL task based on the common children's game of Concentration. We find that a MEM RL agent leverages episodic memory effectively to master Concentration, unlike the baseline agents we tested.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Integrating Episodic Memory into a Reinforcement Learning Agent using Reservoir Sampling

2018-06-01 · ICLR 2018 1 · Kenny J. Young, Richard S. Sutton, Shuo Yang

Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific st…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Solving Continuous Control with Episodic Memory

2021-06-16 · Igor Kuznetsov, Andrey Filchenkov

Episodic memory lets reinforcement learning algorithms remember and exploit promising experience from the past to improve agent performance. Previous works on memory mechanisms show benefits of using episodic-based data …

continuous-control Continuous Control OpenAI Gym Reinforcement Learning (RL)

Efficient Replay Memory Architectures in Multi-Agent Reinforcement Learning for Traffic Congestion Control

2024-07-22 · Mukul Chodhary, Kevin Octavian, SooJean Han

Episodic control, inspired by the role of episodic memory in the human brain, has been shown to improve the sample inefficiency of model-free reinforcement learning by reusing high-return past experiences. However, the m…

Decision Making Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

REMem: Reasoning with Episodic Memory in Language Agent

2026-02-13 · Yiheng Shu, Saisri Padmaja Jonnalagedda, Xiang Gao, Bernal Jiménez Gutiérrez 외 arxiv

Humans excel at remembering concrete experiences along spatiotemporal contexts and performing reasoning across those events, i.e., the capacity for episodic memory. In contrast, memory in language agents remains mainly s…

A model of semantic completion in generative episodic memory

2021-11-26 · Zahra Fayyaz, Aya Altamimi, Sen Cheng, Laurenz Wiskott

Many different studies have suggested that episodic memory is a generative process, but most computational models adopt a storage view. In this work, we propose a computational model for generative episodic memory. It is…

Hippocampus