paper-with-me

홈 › Papers

The Decoupling Concept Bottleneck Model

2024-11-01 · IEEE Transactions on Pattern Analysis and Machine Intelligence 2024 11 · Rui Zhang, Xingbo Du, Junchi Yan, Shihua Zhang

The Concept Bottleneck Model (CBM) is an interpretable neural network that leverages high-level concepts to explainmodel decisions and conduct human-machine interaction. However, in real-world scenarios, the deficiency of informative concepts canimpede the model’s interpretability and subsequent interventions. This paper proves that insufficient concept information can lead to aninherent dilemma of concept and label distortions in CBM. To address this challenge, we propose the Decoupling Concept BottleneckModel (DCBM), which comprises two phases: 1) DCBM for prediction and interpretation, which decouples heterogeneous informationinto explicit and implicit concepts while maintaining high label and concept accuracy, and 2) DCBM for human-machine interaction,which automatically corrects labels and traces wrong concepts via mutual information estimation. The construction of the interactionsystem can be formulated as a light min-max optimization problem. Extensive experiments expose the success of alleviatingconcept/label distortions, especially when concepts are insufficient. In particular, we propose the Concept Contribution Score (CCS) toquantify the interpretability of DCBM. Numerical results demonstrate that CCS can be guaranteed by the Jensen-Shannon divergenceconstraint in DCBM. Moreover, DCBM expresses two effective human-machine interactions, including forward intervention andbackward rectification, to further promote concept/label accuracy via interaction with human experts.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

modelMutual Information Estimation

Similar Papers 제목 키워드 기반

Breaking the Softmax Bottleneck for Sequential Recommender Systems with Dropout and Decoupling

2021-10-11 · Ying-Chen Lin

The Softmax bottleneck was first identified in language modeling as a theoretical limit on the expressivity of Softmax-based models. Being one of the most widely-used methods to output probability, Softmax-based models h…

Language ModelingLanguage ModellingRecommendation Systems

DCD-PFN: A Decoupling-Aware Foundation Model for Causal Discovery

2026-06-19 · Zhengkang Guan, Yikang Chen, Yi He, Yunze Tong 외 arxiv

Causal discovery is critical for understanding complex data-generating mechanisms, yet traditional algorithms often struggle with highly non-linear and noisy systems, or suffer from severe computational bottlenecks. Rece…

Zero-shot Generalization

ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning

2025-01-08 · Yuzhou Huang, Ziyang Yuan, Quande Liu, Qiulin Wang 외

Text-to-video generation has made remarkable advancements through diffusion models. However, Multi-Concept Video Customization (MCVC) remains a significant challenge. We identify two key challenges for this task: 1) the …

Text-to-Video GenerationVideo Generation

Interpretable Neural Network Decoupling

2019-06-04 · ECCV 2020 8 · Yuchao Li, Rongrong Ji, Shaohui Lin, Baochang Zhang 외

The remarkable performance of convolutional neural networks (CNNs) is entangled with their huge number of uninterpretable parameters, which has become the bottleneck limiting the exploitation of their full potential. Tow…

Network Interpretation

Do Concept Bottleneck Models Learn as Intended?

2021-05-10 · Andrei Margeloiu, Matthew Ashman, Umang Bhatt, Yanzhi Chen 외

Concept bottleneck models map from raw inputs to concepts, and then from concepts to targets. Such models aim to incorporate pre-specified, high-level concepts into the learning procedure, and have been motivated to meet…