Evaluating Human-like Explanations for Robot Actions in Reinforcement Learning Scenarios
Explainable artificial intelligence is a research field that tries to provide more transparency for autonomous intelligent systems. Explainability has been used, particularly in reinforcement learning and robotic scenarios, to better understand the robot decision-making process. Previous work, however, has been widely focused on providing technical explanations that can be better understood by AI practitioners than non-expert end-users. In this work, we make use of human-like explanations built from the probability of success to complete the goal that an autonomous robot shows after performing an action. These explanations are intended to be understood by people who have no or very little experience with artificial intelligence methods. This paper presents a user trial to study whether these explanations that focus on the probability an action has of succeeding in its goal constitute a suitable explanation for non-expert end-users. The results obtained show that non-expert participants rate robot explanations that focus on the probability of success higher and with less variance than technical explanations generated from Q-values, and also favor counterfactual explanations over standalone explanations.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualDecision MakingExplainable artificial intelligencereinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
The Influence of Human-like Appearance on Expected Robot Explanations
A robot's appearance is a known factor influencing user's mental model and human-robot interaction, that has not been studied in the context of its influence in expected robot explanations. In this study, we investigate …
Explain yourself! Effects of Explanations in Human-Robot Interaction
Recent developments in explainable artificial intelligence promise the potential to transform human-robot interaction: Explanations of robot decisions could affect user perceptions, justify their reliability, and increas…
Explainable artificial intelligenceUsing Petri Nets for Context-Adaptive Robot Explanations
In human-robot interaction, robots must communicate in a natural and transparent manner to foster trust, which requires adapting their communication to the context. In this paper, we propose using Petri nets (PNs) to mod…
Why Did the Robot Cross the Road? A User Study of Explanation in Human-Robot Interaction
This work documents a pilot user study evaluating the effectiveness of contrastive, causal and example explanations in supporting human understanding of AI in a hypothetical commonplace human robot interaction HRI scenar…
Explainable Artificial Intelligence (XAI)Personalised Explanations in Long-term Human-Robot Interactions
In the field of Human-Robot Interaction (HRI), a fundamental challenge is to facilitate human understanding of robots. The emerging domain of eXplainable HRI (XHRI) investigates methods to generate explanations and evalu…