Explaining Deep Reinforcement Learning Agents In The Atari Domain through a Surrogate Model
One major barrier to applications of deep Reinforcement Learning (RL) both inside and outside of games is the lack of explainability. In this paper, we describe a lightweight and effective method to derive explanations for deep RL agents, which we evaluate in the Atari domain. Our method relies on a transformation of the pixel-based input of the RL agent to an interpretable, percept-like input representation. We then train a surrogate model, which is itself interpretable, to replicate the behavior of the target, deep RL agent. Our experiments demonstrate that we can learn an effective surrogate that accurately approximates the underlying decision making of a target agent on a suite of Atari games.
Code (0)
등록된 구현이 없습니다.
Tasks
Atari GamesDecision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Visualizing and Understanding Atari Agents
While deep reinforcement learning (deep RL) agents are effective at maximizing rewards, it is often unclear what strategies they use to do so. In this paper, we take a step toward explaining deep RL agents through a case…
Deep Reinforcement LearningReinforcement LearningReinforcement Learning (RL)Visual Rationalizations in Deep Reinforcement Learning for Atari Games
Due to the capability of deep learning to perform well in high dimensional problems, deep reinforcement learning agents perform well in challenging tasks such as Atari 2600 games. However, clearly explaining why a certai…
Atari GamesDecision MakingDeep LearningDeep Reinforcement Learning+3Counterfactual States for Atari Agents via Generative Deep Learning
Although deep reinforcement learning agents have produced impressive results in many domains, their decision making is difficult to explain to humans. To address this problem, past work has mainly focused on explaining w…
counterfactualDecision MakingDeep LearningDeep Reinforcement Learning+1Benchmarking Perturbation-based Saliency Maps for Explaining Atari Agents
One of the most prominent methods for explaining the behavior of Deep Reinforcement Learning (DRL) agents is the generation of saliency maps that show how much each pixel attributed to the agents' decision. However, ther…
Atari GamesBenchmarkingDeep Reinforcement LearningFeature Importance+1Virtual Augmented Reality for Atari Reinforcement Learning
Reinforcement Learning (RL) has achieved significant milestones in the gaming domain, most notably Google DeepMind's AlphaGo defeating human Go champion Ken Jie. This victory was also made possible through the Atari Lear…
Image Segmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1