paper-with-me

Papers

Interpretable Generative Models through Post-hoc Concept Bottlenecks

2025-03-25 · CVPR 2025 1 · Akshay Kulkarni, Ge Yan, Chung-En Sun, Tuomas Oikarinen, Tsui-Wei Weng

Concept bottleneck models (CBM) aim to produce inherently interpretable models that rely on human-understandable concepts for their predictions. However, existing approaches to design interpretable generative models based on CBMs are not yet efficient and scalable, as they require expensive generative model training from scratch as well as real images with labor-intensive concept supervision. To address these challenges, we present two novel and low-cost methods to build interpretable generative models through post-hoc techniques and we name our approaches: concept-bottleneck autoencoder (CB-AE) and concept controller (CC). Our proposed approaches enable efficient and scalable training without the need of real data and require only minimal to no concept supervision. Additionally, our methods generalize across modern generative model families including generative adversarial networks and diffusion models. We demonstrate the superior interpretability and steerability of our methods on numerous standard datasets like CelebA, CelebA-HQ, and CUB with large improvements (average ~25%) over the prior work, while being 4-15x faster to train. Finally, a large-scale user study is performed to validate the interpretability and steerability of our methods.

📄 PDF Abstract BibTeX arXiv:2503.19377

Code (1)

Trustworthy-ML-Lab/posthoc-generative-cbm 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

CoBELa: Steering Transparent Generation via Concept Bottlenecks on Energy Landscapes

2025-07-11 · Sangwon Kim, Kyoungoh Lee, Jeyoun Dong, Kwang-Ju Kim arxiv

Generative concept bottleneck models aim to enable interpretable generation by routing synthesis through explicit, user-facing concepts. In practice, prior approaches often rely on non-explicit bottleneck representations…

Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

2022-11-21 · CVPR 2023 1 · Yue Yang, Artemis Panagopoulou, Shenghao Zhou, Daniel Jin 외

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-sta…

image-classificationImage ClassificationLanguage ModelingLanguage Modelling

Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis

2026-08-04 · Chengyu Wu, Junpeng Tan, Wanxiang Luo, Yaqi Wang 외 arxiv

Human-interpretable computer-aided diagnosis is crucial for clinical decision making. Concept-based models excel by providing transparent reasoning and enabling post-hoc, clinician-in-the-loop interventions. However, the…

Decision Making

Interpretable Reward Modeling with Active Concept Bottlenecks

2025-07-07 · Sonia Laguna, Katarzyna Kobalczyk, Julia E. Vogt, Mihaela Van der Schaar arxiv

We introduce Concept Bottleneck Reward Models (CB-RM), a reward modeling framework that enables interpretable preference learning through selective concept annotation. Unlike standard RLHF methods that rely on opaque rew…

Active Learning

Object Centric Concept Bottlenecks

2025-05-30 · David Steinmann, Wolfgang Stammer, Antonia Wüst, Kristian Kersting

Developing high-performing, yet interpretable models remains a critical challenge in modern AI. Concept-based models (CBMs) attempt to address this by extracting human-understandable concepts from a global encoding (e.g.…

Decision MakingObject