Generating Explanations from Deep Reinforcement Learning Using Episodic Memory

2022-05-18 · Sam Blakeman, Denis Mareschal

Deep Reinforcement Learning (RL) involves the use of Deep Neural Networks (DNNs) to make sequential decisions in order to maximize reward. For many tasks the resulting sequence of actions produced by a Deep RL policy can be long and difficult to understand for humans. A crucial component of human explanations is selectivity, whereby only key decisions and causes are recounted. Imbuing Deep RL agents with such an ability would make their resulting policies easier to understand from a human perspective and generate a concise set of instructions to aid the learning of future agents. To this end we use a Deep RL agent with an episodic memory system to identify and recount key decisions during policy execution. We show that these decisions form a short, human readable explanation that can also be used to speed up the learning of naive Deep RL agents in an algorithm-independent manner.

📄 PDF Abstract BibTeX arXiv:2205.08926

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Two-Memory Reinforcement Learning

2023-04-20 · Zhao Yang, Thomas. M. Moerland, Mike Preuss, Aske Plaat

While deep reinforcement learning has shown important empirical success, it tends to learn relatively slow due to slow propagation of rewards information and slow update of parametric neural networks. Non-parametric epis…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Representation Learning+1

Introspection-based Explainable Reinforcement Learning in Episodic and Non-episodic Scenarios

2022-11-23 · Niclas Schroeter, Francisco Cruz, Stefan Wermter

With the increasing presence of robotic systems and human-robot environments in today's society, understanding the reasoning behind actions taken by a robot is becoming more important. To increase this understanding, use…

reinforcement-learning Reinforcement Learning (RL)

Now I Remember! Episodic Memory For Reinforcement Learning

2018-01-01 · ICLR 2018 1 · Ricky Loynd, Matthew Hausknecht, Lihong Li, Li Deng

Humans rely on episodic memory constantly, in remembering the name of someone they met 10 minutes ago, the plot of a movie as it unfolds, or where they parked the car. Endowing reinforcement learning agents with episodic…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Model-Based Episodic Memory Induces Dynamic Hybrid Controls

2021-11-03 · NeurIPS 2021 12 · Hung Le, Thommen Karimpanal George, Majid Abdolshah, Truyen Tran 외

Episodic control enables sample efficiency in reinforcement learning by recalling past experiences from an episodic memory. We propose a new model-based episodic memory of trajectories addressing current limitations of e…

model reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Episodic Reinforcement Learning with Associative Memory

2020-05-01 · ICLR 2020 1 · Guangxiang Zhu*, Zichuan Lin*, Guangwen Yang, Chongjie Zhang

Sample efficiency has been one of the major challenges for deep reinforcement learning. Non-parametric episodic control has been proposed to speed up parametric reinforcement learning by rapidly latching on previously su…

Atari Games Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1