Leveraging Counterfactual Paths for Contrastive Explanations of POMDP Policies
As humans come to rely on autonomous systems more, ensuring the transparency of such systems is important to their continued adoption. Explainable Artificial Intelligence (XAI) aims to reduce confusion and foster trust in systems by providing explanations of agent behavior. Partially observable Markov decision processes (POMDPs) provide a flexible framework capable of reasoning over transition and state uncertainty, while also being amenable to explanation. This work investigates the use of user-provided counterfactuals to generate contrastive explanations of POMDP policies. Feature expectations are used as a means of contrasting the performance of these policies. We demonstrate our approach in a Search and Rescue (SAR) setting. We analyze and discuss the associated challenges through two case studies.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generating Counterfactual and Contrastive Explanations using SHAP
With the advent of GDPR, the domain of explainable AI and model interpretability has gained added impetus. Methods to extract and communicate visibility into decision-making models have become legal requirement. Two spec…
counterfactualDecision MakingContrastive Learning with Counterfactual Explanations for Radiology Report Generation
Due to the common content of anatomy, radiology images with their corresponding reports exhibit high similarity. Such inherent data bias can predispose automatic report generation models to learn entangled and spurious r…
AnatomyContrastive LearningcounterfactualLanguage Modeling+3FACE: Feasible and Actionable Counterfactual Explanations
Work in Counterfactual Explanations tends to focus on the principle of "the closest possible world" that identifies small changes leading to the desired outcome. In this paper we argue that while this approach might init…
counterfactualCausal Generative Explainers using Counterfactual Inference: A Case Study on the Morpho-MNIST Dataset
In this paper, we propose leveraging causal generative learning as an interpretable tool for explaining image classifiers. Specifically, we present a generative counterfactual inference approach to study the influence of…
AttributecounterfactualCounterfactual ExplanationCounterfactual InferenceExplaining and visualizing black-box models through counterfactual paths
Explainable AI (XAI) is an increasingly important area of machine learning research, which aims to make black-box models transparent and interpretable. In this paper, we propose a novel approach to XAI that uses the so-c…
counterfactualExplainable Artificial Intelligence (XAI)Feature ImportanceKnowledge Graphs