The Decoupling Concept Bottleneck Model
The Concept Bottleneck Model (CBM) is an interpretable neural network that leverages high-level concepts to explainmodel decisions and conduct human-machine interaction. However, in real-world scenarios, the deficiency of informative concepts canimpede the model’s interpretability and subsequent interventions. This paper proves that insufficient concept information can lead to aninherent dilemma of concept and label distortions in CBM. To address this challenge, we propose the Decoupling Concept BottleneckModel (DCBM), which comprises two phases: 1) DCBM for prediction and interpretation, which decouples heterogeneous informationinto explicit and implicit concepts while maintaining high label and concept accuracy, and 2) DCBM for human-machine interaction,which automatically corrects labels and traces wrong concepts via mutual information estimation. The construction of the interactionsystem can be formulated as a light min-max optimization problem. Extensive experiments expose the success of alleviatingconcept/label distortions, especially when concepts are insufficient. In particular, we propose the Concept Contribution Score (CCS) toquantify the interpretability of DCBM. Numerical results demonstrate that CCS can be guaranteed by the Jensen-Shannon divergenceconstraint in DCBM. Moreover, DCBM expresses two effective human-machine interactions, including forward intervention andbackward rectification, to further promote concept/label accuracy via interaction with human experts.
Code (0)
등록된 구현이 없습니다.
Tasks
modelMutual Information EstimationSimilar Papers 제목 키워드 기반
Breaking the Softmax Bottleneck for Sequential Recommender Systems with Dropout and Decoupling
The Softmax bottleneck was first identified in language modeling as a theoretical limit on the expressivity of Softmax-based models. Being one of the most widely-used methods to output probability, Softmax-based models h…
Language ModelingLanguage ModellingRecommendation SystemsDCD-PFN: A Decoupling-Aware Foundation Model for Causal Discovery
Causal discovery is critical for understanding complex data-generating mechanisms, yet traditional algorithms often struggle with highly non-linear and noisy systems, or suffer from severe computational bottlenecks. Rece…
Zero-shot GeneralizationConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning
Text-to-video generation has made remarkable advancements through diffusion models. However, Multi-Concept Video Customization (MCVC) remains a significant challenge. We identify two key challenges for this task: 1) the …
Text-to-Video GenerationVideo GenerationInterpretable Neural Network Decoupling
The remarkable performance of convolutional neural networks (CNNs) is entangled with their huge number of uninterpretable parameters, which has become the bottleneck limiting the exploitation of their full potential. Tow…
Network InterpretationDo Concept Bottleneck Models Learn as Intended?
Concept bottleneck models map from raw inputs to concepts, and then from concepts to targets. Such models aim to incorporate pre-specified, high-level concepts into the learning procedure, and have been motivated to meet…