Two-step counterfactual generation for OOD examples
Two fundamental requirements for the deployment of machine learning models in safety-critical systems are to be able to detect out-of-distribution (OOD) data correctly and to be able to explain the prediction of the model. Although significant effort has gone into both OOD detection and explainable AI, there has been little work on explaining why a model predicts a certain data point is OOD. In this paper, we address this question by introducing the concept of an OOD counterfactual, which is a perturbed data point that iteratively moves between different OOD categories. We propose a method for generating such counterfactuals, investigate its application on synthetic and benchmark data, and compare it to several benchmark methods using a range of metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualOut of Distribution (OOD) DetectionVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis
As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing …
counterfactualCounterfactual ExplanationCOCO-Counterfactuals: Automatically Constructed Counterfactual Examples for Image-Text Pairs
Counterfactual examples have proven to be valuable in the field of natural language processing (NLP) for both evaluating and improving the robustness of language models to spurious correlations in datasets. Despite their…
counterfactualData AugmentationDomain GeneralizationUsing LLMs for Explaining Sets of Counterfactual Examples to Final Users
Causality is vital for understanding true cause-and-effect relationships between variables within predictive models, rather than relying on mere correlations, making it highly relevant in the field of Explainable AI. In …
Causal InferencecounterfactualCREST: A Joint Framework for Rationalization and Counterfactual Text Generation
Selective rationales and counterfactual examples have emerged as two effective, complementary classes of interpretability methods for analyzing and training NLP models. However, prior work has not explored how these meth…
counterfactualData AugmentationText GenerationvalidFitCF: A Framework for Automatic Feature Importance-guided Counterfactual Example Generation
Counterfactual examples are widely used in natural language processing (NLP) as valuable data to improve models, and in explainable artificial intelligence (XAI) to understand model behavior. The automated generation of …
counterfactualExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Feature Importance