Explaining Agent's Decision-making in a Hierarchical Reinforcement Learning Scenario

2022-12-14 · Hugo Muñoz, Ernesto Portugal, Angel Ayala, Bruno Fernandes, Francisco Cruz

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem occurs when reinforcement learning is used in critical contexts where the users of the system need to have more information and reliability for the actions executed by an agent. In this regard, explainable reinforcement learning seeks to provide to an agent in training with methods in order to explain its behavior in such a way that users with no experience in machine learning could understand the agent's behavior. One of these is the memory-based explainable reinforcement learning method that is used to compute probabilities of success for each state-action pair using an episodic memory. In this work, we propose to make use of the memory-based explainable reinforcement learning method in a hierarchical environment composed of sub-tasks that need to be first addressed to solve a more complex task. The end goal is to verify if it is possible to provide to the agent the ability to explain its actions in the global task as well as in the sub-tasks. The results obtained showed that it is possible to use the memory-based method in hierarchical environments with high-level tasks and compute the probabilities of success to be used as a basis for explaining the agent's behavior.

📄 PDF Abstract BibTeX arXiv:2212.06967

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Visual Rationalizations in Deep Reinforcement Learning for Atari Games

2019-02-01 · Laurens Weitkamp, Elise van der Pol, Zeynep Akata

Due to the capability of deep learning to perform well in high dimensional problems, deep reinforcement learning agents perform well in challenging tasks such as Atari 2600 games. However, clearly explaining why a certai…

Atari Games Decision Making Deep Learning Deep Reinforcement Learning+3

Integrating Policy Summaries with Reward Decomposition for Explaining Reinforcement Learning Agents

2022-10-21 · Yael Septon, Tobias Huber, Elisabeth André, Ofra Amir

Explaining the behavior of reinforcement learning agents operating in sequential decision-making settings is challenging, as their behavior is affected by a dynamic environment and delayed rewards. Methods that help user…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Quantum Hierarchical Reinforcement Learning via Variational Quantum Circuits

2026-05-05 · Yu-Ting Lee, Samuel Yen-Chi Chen, Fu-Chieh Chang arxiv

Reinforcement learning is one of the most challenging learning paradigms where efficacy and efficiency gains are extremely valuable. Hierarchical reinforcement learning is a variant that leverages temporal abstraction to…

Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning for Optimal Agent Grouping in Cooperative Systems

2025-01-11 · Liyuan Hu

This paper presents a hierarchical reinforcement learning (RL) approach to address the agent grouping or pairing problem in cooperative multi-agent systems. The goal is to simultaneously learn the optimal grouping and ag…

Decision Making Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Moody Learners -- Explaining Competitive Behaviour of Reinforcement Learning Agents

2020-07-30 · Pablo Barros, Ana Tanevska, Francisco Cruz, Alessandra Sciutti

Designing the decision-making processes of artificial agents that are involved in competitive interactions is a challenging task. In a competitive scenario, the agent does not only have a dynamic environment but also is …

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)