Complementary reinforcement learning towards explainable agents

2019-01-01 · Jung Hoon Lee

Reinforcement learning (RL) algorithms allow agents to learn skills and strategies to perform complex tasks without detailed instructions or expensive labelled training examples. That is, RL agents can learn, as we learn. Given the importance of learning in our intelligence, RL has been thought to be one of key components to general artificial intelligence, and recent breakthroughs in deep reinforcement learning suggest that neural networks (NN) are natural platforms for RL agents. However, despite the efficiency and versatility of NN-based RL agents, their decision-making remains incomprehensible, reducing their utilities. To deploy RL into a wider range of applications, it is imperative to develop explainable NN-based RL agents. Here, we propose a method to derive a secondary comprehensible agent from a NN-based RL agent, whose decision-makings are based on simple rules. Our empirical evaluation of this secondary agent's performance supports the possibility of building a comprehensible and transparent agent using a NN-based RL agent.

📄 PDF Abstract BibTeX arXiv:1901.00188

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Survey of Explainable Reinforcement Learning

2022-02-17 · Stephanie Milani, Nicholay Topin, Manuela Veloso, Fei Fang

Explainable reinforcement learning (XRL) is an emerging subfield of explainable machine learning that has attracted considerable attention in recent years. The goal of XRL is to elucidate the decision-making process of l…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+2

Explaining Reinforcement Learning Agents Through Counterfactual Action Outcomes

2023-12-18 · Yotam Amitai, Yael Septon, Ofra Amir

Explainable reinforcement learning (XRL) methods aim to help elucidate agent policies and decision-making processes. The majority of XRL approaches focus on local explanations, seeking to shed light on the reasons an age…

counterfactual Decision Making reinforcement-learning Reinforcement Learning

Explainable Reinforcement Learning Agents Using World Models

2025-05-12 · Madhuri Singh, Amal Alabdulkarim, Gennie Mansi, Mark O. Riedl

Explainable AI (XAI) systems have been proposed to help people understand how AI systems produce outputs and behaviors. Explainable Reinforcement Learning (XRL) has an added complexity due to the temporal nature of seque…

counterfactual reinforcement-learning Reinforcement Learning Sequential Decision Making

Towards a Research Community in Interpretable Reinforcement Learning: the InterpPol Workshop

2024-04-16 · Hector Kohler, Quentin Delfosse, Paul Festor, Philippe Preux

Embracing the pursuit of intrinsically explainable reinforcement learning raises crucial questions: what distinguishes explainability from interpretability? Should explainable and interpretable agents be developed outsid…

reinforcement-learning Reinforcement Learning

A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges

2022-11-12 · Yunpeng Qing, Shunyu Liu, Jie Song, Huiqiong Wang 외

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnesse…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Survey