Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?
Concept-based XAI (C-XAI) approaches to explaining neural vision models are a promising field of research, since explanations that refer to concepts (i.e., semantically meaningful parts in an image) are intuitive to understand and go beyond saliency-based techniques that only reveal relevant regions. Given the remarkable progress in this field in recent years, it is time for the community to take a critical look at the advances and trends. Consequently, this paper reviews C-XAI methods to identify interesting and underexplored areas and proposes future research directions. To this end, we consider three main directions: the choice of concepts to explain, the choice of concept representation, and how we can control concepts. For the latter, we propose techniques and draw inspiration from the field of knowledge representation and learning, showing how this could enrich future C-XAI research.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CoLa-DCE -- Concept-guided Latent Diffusion Counterfactual Explanations
Recent advancements in generative AI have introduced novel prospects and practical implementations. Especially diffusion models show their strength in generating diverse and, at the same time, realistic features, positio…
CoLAcounterfactualimage-classificationImage ClassificationConcept-based Explanations using Non-negative Concept Activation Vectors and Decision Tree for CNN Models
This paper evaluates whether training a decision tree based on concepts extracted from a concept-based explainer can increase interpretability for Convolutional Neural Networks (CNNs) models and boost the fidelity and pe…
Hierarchical Concept Embedding & Pursuit for Interpretable Image Classification
Interpretable-by-design models are gaining traction in computer vision because they provide faithful explanations for their predictions. In image classification, these models typically recover human-interpretable concept…
Image ClassificationCoProNN: Concept-based Prototypical Nearest Neighbors for Explaining Vision Models
Mounting evidence in explainability for artificial intelligence (XAI) research suggests that good explanations should be tailored to individual tasks and should relate to concepts relevant to the task. However, building …
image-classificationImage ClassificationInteractivity x Explainability: Toward Understanding How Interactivity Can Improve Computer Vision Explanations
Explanations for computer vision models are important tools for interpreting how the underlying models work. However, they are often presented in static formats, which pose challenges for users, including information ove…