Counterfactual Explanation and Causal Inference in Service of Robustness in Robot Control
We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an image-based deep neural network model is trained to produce small and realistic modifications to an original image in order to cause user-defined effects. These modifications can be used in the design process of image-based robust control - to determine the ability of the controller to return to a working regime by modifications in the input space, rather than by adaptation. In contrast to conventional control design approaches, where robustness is quantified in terms of the ability to reject noise, we explore the space of counterfactuals that might cause a certain requirement to be violated, thus proposing an alternative model that might be more expressive in certain robotics applications. So, we propose the generation of counterfactuals as an approach to explanation of black-box models and the envisioning of potential movement paths in autonomous robotic control. Firstly, we demonstrate this approach in a set of classification tasks, using the well known MNIST and CelebFaces Attributes datasets. Then, addressing multi-dimensional regression, we demonstrate our approach in a reaching task with a physical robot, and in a navigation task with a robot in a digital twin simulation.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal InferencecounterfactualCounterfactual ExplanationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Causal Generative Explainers using Counterfactual Inference: A Case Study on the Morpho-MNIST Dataset
In this paper, we propose leveraging causal generative learning as an interpretable tool for explaining image classifiers. Specifically, we present a generative counterfactual inference approach to study the influence of…
AttributecounterfactualCounterfactual ExplanationCounterfactual InferenceCEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior
The increasing size and complexity of modern ML systems has improved their predictive capabilities but made their behavior harder to explain. Many techniques for model explanation have been developed in response, but we …
Causal InferencecounterfactualFeatures of Explainability: How users understand counterfactual and causal explanations for categorical and continuous features in XAI
Counterfactual explanations are increasingly used to address interpretability, recourse, and bias in AI decisions. However, we do not know how well counterfactual explanations help users to understand a systems decisions…
counterfactualExplainable Artificial Intelligence (XAI)CLEAR: Generative Counterfactual Explanations on Graphs
Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance be…
counterfactualCounterfactual ExplanationExplanation GenerationCounterfactual Visual Explanation via Causally-Guided Adversarial Steering
Recent work on counterfactual visual explanations has contributed to making artificial intelligence models more explainable by providing visual perturbation to flip the prediction. However, these approaches neglect the c…
Image Generation