paper-with-me

홈 › Papers

Concept Bottleneck Model with Additional Unsupervised Concepts

2022-02-03 · Yoshihide Sawada, Keigo Nakamura

With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this article, we propose a novel interpretable model based on the concept bottleneck model (CBM). CBM uses concept labels to train an intermediate layer as the additional visible layer. However, because the number of concept labels restricts the dimension of this layer, it is difficult to obtain high accuracy with a small number of labels. To address this issue, we integrate supervised concepts with unsupervised ones trained with self-explaining neural networks (SENNs). By seamlessly training these two types of concepts while reducing the amount of computation, we can obtain both supervised and unsupervised concepts simultaneously, even for large-sized images. We refer to the proposed model as the concept bottleneck model with additional unsupervised concepts (CBM-AUC). We experimentally confirmed that the proposed model outperformed CBM and SENN. We also visualized the saliency map of each concept and confirmed that it was consistent with the semantic meanings.

📄 PDF Abstract BibTeX arXiv:2202.01459

Code (0)

등록된 구현이 없습니다.

Tasks

model

Similar Papers 제목 키워드 기반

Towards Achieving Concept Completeness for Textual Concept Bottleneck Models

2025-02-16 · Milan Bhan, Yann Choho, Pierre Moreau, Jean-Noel Vittaut 외

Textual Concept Bottleneck Models (TBMs) are interpretable-by-design models for text classification that predict a set of salient concepts before making the final prediction. This paper proposes Complete Textual Concept …

Language ModelingLanguage ModellingSmall Language Modeltext-classification+1

Concept Bottleneck Models Without Predefined Concepts

2024-07-04 · Simon Schrodi, Julian Schur, Max Argus, Thomas Brox

There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and then map them to output classes. To reduce …

Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning

2024-04-04 · Andrei Semenov, Vladimir Ivanov, Aleksandr Beznosikov, Alexander Gasnikov

We propose a novel architecture and method of explainable classification with Concept Bottleneck Models (CBMs). While SOTA approaches to Image Classification task work as a black box, there is a growing demand for models…

Contrastive Learningimage-classificationImage ClassificationInterpretable Machine Learning+1

Zero-shot Concept Bottleneck Models

2025-02-13 · Shin'ya Yamaguchi, Kosuke Nishida, Daiki Chijiwa, Yasutoshi Ida

Concept bottleneck models (CBMs) are inherently interpretable and intervenable neural network models, which explain their final label prediction by the intermediate prediction of high-level semantic concepts. However, th…

regression

Chat-CBM: Towards Interactive Concept Bottleneck Models with Frozen Large Language Models

2025-09-22 · Hangzhou He, Lei Zhu, Kaiwen Li, Xinliang Zhang 외 arxiv

Concept Bottleneck Models (CBMs) provide inherent interpretability by first predicting a set of human-understandable concepts and then mapping them to labels through a simple classifier. While users can intervene in the …