paper-with-me

홈 › Papers

ConLUX: Concept-Based Local Unified Explanations

2024-10-16 · Junhao Liu, Haonan Yu, Xin Zhang

With the rapid advancements of various machine learning models, there is a significant demand for model-agnostic explanation techniques, which can explain these models across different architectures. Mainstream model-agnostic explanation techniques generate local explanations based on basic features (e.g., words for text models and (super-)pixels for image models). However, these explanations often do not align with the decision-making processes of the target models and end-users, resulting in explanations that are unfaithful and difficult for users to understand. On the other hand, concept-based techniques provide explanations based on high-level features (e.g., topics for text models and objects for image models), but most are model-specific or require additional pre-defined external concept knowledge. To address this limitation, we propose \toolname, a general framework to provide concept-based local explanations for any machine learning models. Our key insight is that we can automatically extract high-level concepts from large pre-trained models, and uniformly extend existing local model-agnostic techniques to provide unified concept-based explanations. We have instantiated \toolname on four different types of explanation techniques: LIME, Kernel SHAP, Anchor, and LORE, and applied these techniques to text and image models. Our evaluation results demonstrate that 1) compared to the vanilla versions, \toolname offers more faithful explanations and makes them more understandable to users, and 2) by offering multiple forms of explanations, \toolname outperforms state-of-the-art concept-based explanation techniques specifically designed for text and image models, respectively.

📄 PDF Abstract BibTeX arXiv:2410.12439

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SHAP 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

A Unified Concept-Based System for Local, Global, and Misclassification Explanations

2023-06-06 · Fatemeh Aghaeipoor, Dorsa Asgarian, Mohammad Sabokrou

Explainability of Deep Neural Networks (DNNs) has been garnering increasing attention in recent years. Of the various explainability approaches, concept-based techniques stand out for their ability to utilize human-meani…

Evaluating Readability and Faithfulness of Concept-based Explanations

2024-04-29 · Meng Li, Haoran Jin, Ruixuan Huang, Zhihao Xu 외

With the growing popularity of general-purpose Large Language Models (LLMs), comes a need for more global explanations of model behaviors. Concept-based explanations arise as a promising avenue for explaining high-level …

UFO: A unified method for controlling Understandability and Faithfulness Objectives in concept-based explanations for CNNs

2023-03-27 · Vikram V. Ramaswamy, Sunnie S. Y. Kim, Ruth Fong, Olga Russakovsky

Concept-based explanations for convolutional neural networks (CNNs) aim to explain model behavior and outputs using a pre-defined set of semantic concepts (e.g., the model recognizes scene class ``bedroom'' based on the …

DEAL: Disentangle and Localize Concept-level Explanations for VLMs

2024-07-19 · Tang Li, Mengmeng Ma, Xi Peng

Large pre-trained Vision-Language Models (VLMs) have become ubiquitous foundational components of other models and downstream tasks. Although powerful, our empirical results reveal that such models might not be able to i…

Feature Importance versus Feature Influence and What It Signifies for Explainable AI

2023-08-07 · Kary Främling

When used in the context of decision theory, feature importance expresses how much changing the value of a feature can change the model outcome (or the utility of the outcome), compared to other features. Feature importa…

Feature Importance