paper-with-me

Papers

Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classification

2023-07-10 · Haixing Dai, Lu Zhang, Lin Zhao, Zihao Wu, Zhengliang Liu, David Liu, Xiaowei Yu, Yanjun Lyu, Changying Li, Ninghao Liu, Tianming Liu, Dajiang Zhu

With the popularity of deep neural networks (DNNs), model interpretability is becoming a critical concern. Many approaches have been developed to tackle the problem through post-hoc analysis, such as explaining how predictions are made or understanding the meaning of neurons in middle layers. Nevertheless, these methods can only discover the patterns or rules that naturally exist in models. In this work, rather than relying on post-hoc schemes, we proactively instill knowledge to alter the representation of human-understandable concepts in hidden layers. Specifically, we use a hierarchical tree of semantic concepts to store the knowledge, which is leveraged to regularize the representations of image data instances while training deep models. The axes of the latent space are aligned with the semantic concepts, where the hierarchical relations between concepts are also preserved. Experiments on real-world image datasets show that our method improves model interpretability, showing better disentanglement of semantic concepts, without negatively affecting model classification performance.

📄 PDF Abstract BibTeX arXiv:2307.04343

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDisentanglementimage-classificationImage Classification

Similar Papers 제목 키워드 기반

MindCraft: How Concept Trees Take Shape In Deep Models

2025-09-26 · Bowei Tian, Yexiao He, Wanghao Ye, Ziyao Wang 외 arxiv

Large-scale foundation models demonstrate strong performance across language, vision, and reasoning tasks. However, how they internally structure and stabilize concepts remains elusive. Inspired by causal inference, we i…

Medical DiagnosisCausal Inference

Concept Whitening for Interpretable Image Recognition

2020-02-05 · Zhi Chen, Yijie Bei, Cynthia Rudin

What does a neural network encode about a concept as we traverse through the layers? Interpretability in machine learning is undoubtedly important, but the calculations of neural networks are very challenging to understa…

Hierarchical Concept Embedding & Pursuit for Interpretable Image Classification

2026-02-11 · Nghia Nguyen, Tianjiao Ding, René Vidal arxiv

Interpretable-by-design models are gaining traction in computer vision because they provide faithful explanations for their predictions. In image classification, these models typically recover human-interpretable concept…

Image Classification

Hierarchical, Interpretable, Label-Free Concept Bottleneck Model

2026-04-02 · Haodong Xie, Yujun Cai, Rahul Singh Maharjan, Yiwei Wang 외 arxiv

Concept Bottleneck Models (CBMs) introduce interpretability to black-box deep learning models by predicting labels through human-understandable concepts. However, unlike humans, who identify objects at different levels o…

Formal Concept Lattices are Good Semantic Scaffolds for Concept-Based Learning

2026-06-03 · Deepika SN Vemuri, Sayanta Adhikari, Ankit Saha, Krishn Vishwas Kher 외 arxiv

Learning semantics is essential for deep learning models to be interpretable and better aligned with human reasoning. Concept-based models approach this by representing classes through meaningful semantic abstractions, b…