ViCE: Visual Counterfactual Explanations for Machine Learning Models
The continued improvements in the predictive accuracy of machine learning models have allowed for their widespread practical application. Yet, many decisions made with seemingly accurate models still require verification by domain experts. In addition, end-users of a model also want to understand the reasons behind specific decisions. Thus, the need for interpretability is increasingly paramount. In this paper we present an interactive visual analytics tool, ViCE, that generates counterfactual explanations to contextualize and evaluate model decisions. Each sample is assessed to identify the minimal set of changes needed to flip the model's output. These explanations aim to provide end-users with personalized actionable insights with which to understand, and possibly contest or improve, automated decisions. The results are effectively displayed in a visual interface where counterfactual explanations are highlighted and interactive methods are provided for users to explore the data and model. The functionality of the tool is demonstrated by its application to a home equity line of credit dataset.
Code (1)
Tasks
BIG-bench Machine LearningcounterfactualMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AdViCE: Aggregated Visual Counterfactual Explanations for Machine Learning Model Validation
Rapid improvements in the performance of machine learning models have pushed them to the forefront of data-driven decision-making. Meanwhile, the increased integration of these models into various application domains has…
BIG-bench Machine LearningcounterfactualDecision MakingDECE: Decision Explorer with Counterfactual Explanations for Machine Learning Models
With machine learning models being increasingly applied to various decision-making scenarios, people have spent growing efforts to make machine learning models more transparent and explainable. Among various explanation …
BIG-bench Machine LearningcounterfactualCounterfactual ExplanationDecision MakingCounterfactual Visual Explanations
In this work, we develop a technique to produce counterfactual visual explanations. Given a 'query' image $I$ for which a vision system predicts class $c$, a counterfactual visual explanation identifies how $I$ could cha…
counterfactualGeneral Classificationimage-classificationImage ClassificationLD-ViCE: Latent Diffusion Model for Video Counterfactual Explanations
Video-based AI systems are increasingly adopted in safety-critical domains such as autonomous driving and healthcare. However, interpreting their decisions remains challenging due to the inherent spatiotemporal complexit…
Action RecognitionAutonomous DrivingMaking Heads or Tails: Towards Semantically Consistent Visual Counterfactuals
A visual counterfactual explanation replaces image regions in a query image with regions from a distractor image such that the system's decision on the transformed image changes to the distractor class. In this work, we …
counterfactualCounterfactual ExplanationFine-Grained Image Recognition