paper-with-me

홈 › Papers

Language Guided Concept Bottleneck Models for Interpretable Continual Learning

2025-03-30 · CVPR 2025 1 · Lu Yu, Haoyu Han, Zhe Tao, Hantao Yao, Changsheng Xu

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability across tasks. Most existing CL methods focus primarily on preserving learned knowledge to improve model performance. However, as new information is introduced, the interpretability of the learning process becomes crucial for understanding the evolving decision-making process, yet it is rarely explored. In this paper, we introduce a novel framework that integrates language-guided Concept Bottleneck Models (CBMs) to address both challenges. Our approach leverages the Concept Bottleneck Layer, aligning semantic consistency with CLIP models to learn human-understandable concepts that can generalize across tasks. By focusing on interpretable concepts, our method not only enhances the models ability to retain knowledge over time but also provides transparent decision-making insights. We demonstrate the effectiveness of our approach by achieving superior performance on several datasets, outperforming state-of-the-art methods with an improvement of up to 3.06% in final average accuracy on ImageNet-subset. Additionally, we offer concept visualizations for model predictions, further advancing the understanding of interpretable continual learning.

📄 PDF Abstract BibTeX arXiv:2503.23283

Code (1)

fishercats/clg-cbm 공식 구현 pytorch

Tasks

Continual LearningDecision Making

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

2022-11-21 · CVPR 2023 1 · Yue Yang, Artemis Panagopoulou, Shenghao Zhou, Daniel Jin 외

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-sta…

image-classificationImage ClassificationLanguage ModelingLanguage Modelling

Tree of Concepts: Interpretable Continual Learners in Non-Stationary Clinical Domains

2026-04-18 · Dongkyu Cho, Xiyue Li, Samrachana Adhikari, Rumi Chunara arxiv

Continual learning aims to update models under distribution shift without forgetting, yet many high-stakes deployments, such as healthcare, also require interpretability. In practice, models that adapt well (e.g., deep n…

Continual Learning

CI-CBM: Class-Incremental Concept Bottleneck Model for Interpretable Continual Learning

2026-04-16 · Amirhosein Javadi, Tuomas Oikarinen, Tara Javidi, Tsui-Wei Weng arxiv

Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a new task. This issue is especially pronounced in class incremental learn…

Class Incremental LearningContinual Learning

Concepts Worth Having: Refining VLM-Guided Concept Bottleneck Models with Minimal Annotations

2026-05-13 · Nicola Debole, Andrea Passerini, Stefano Teso, Andrea Pugnana 외 arxiv

Concept-bottleneck models (CBMs) are neural classifiers that compute predictions from high-level concepts extracted from the input. CBMs ensure stakeholders can understand the concepts -- and the predictions they entail …

Active Learning

ConceptTS: LLM-Guided Concept Bottlenecks for Interpretable Multivariate Time-Series Forecasting

2026-08-21 · Yichen Jiang, Yueqiao Chen, Dongyu Liu arxiv

State-of-the-art multivariate time-series forecasters can model complex temporal and cross-variable dependencies, yet their opaque representations provide limited insight into why a particular forecast is produced. This …