paper-with-me

홈 › Papers

Interpretable Few-Shot Image Classification via Prototypical Concept-Guided Mixture of LoRA Experts

2025-06-05 · Zhong Ji, Rongshuai Wei, Jingren Liu, Yanwei Pang, Jungong Han

Self-Explainable Models (SEMs) rely on Prototypical Concept Learning (PCL) to enable their visual recognition processes more interpretable, but they often struggle in data-scarce settings where insufficient training samples lead to suboptimal performance.To address this limitation, we propose a Few-Shot Prototypical Concept Classification (FSPCC) framework that systematically mitigates two key challenges under low-data regimes: parametric imbalance and representation misalignment. Specifically, our approach leverages a Mixture of LoRA Experts (MoLE) for parameter-efficient adaptation, ensuring a balanced allocation of trainable parameters between the backbone and the PCL module.Meanwhile, cross-module concept guidance enforces tight alignment between the backbone's feature representations and the prototypical concept activation patterns.In addition, we incorporate a multi-level feature preservation strategy that fuses spatial and semantic cues across various layers, thereby enriching the learned representations and mitigating the challenges posed by limited data availability.Finally, to enhance interpretability and minimize concept overlap, we introduce a geometry-aware concept discrimination loss that enforces orthogonality among concepts, encouraging more disentangled and transparent decision boundaries.Experimental results on six popular benchmarks (CUB-200-2011, mini-ImageNet, CIFAR-FS, Stanford Cars, FGVC-Aircraft, and DTD) demonstrate that our approach consistently outperforms existing SEMs by a notable margin, with 4.2%-8.7% relative gains in 5-way 5-shot classification.These findings highlight the efficacy of coupling concept learning with few-shot adaptation to achieve both higher accuracy and clearer model interpretability, paving the way for more transparent visual recognition systems.

📄 PDF Abstract BibTeX arXiv:2506.04673

Code (0)

등록된 구현이 없습니다.

Tasks

Explainable ModelsFew-Shot Image Classificationimage-classificationImage Classification

Similar Papers 제목 키워드 기반

This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizations

2023-09-21 · NeurIPS 2023 11

We present ProtoConcepts, a method for interpretable image classification combining deep learning and case-based reasoning using prototypical parts. Existing work in prototype-based image classification uses a "this look…

Interpretable Concept-based Prototypical Networks for Few-Shot Learning

2022-02-27 · Mohammad Reza Zarei, Majid Komeili

Few-shot learning aims at recognizing new instances from classes with limited samples. This challenging task is usually alleviated by performing meta-learning on similar tasks. However, the resulting models are black-box…

Few-Shot LearningMeta-Learning

Variational Prototyping-Encoder: One-Shot Learning with Prototypical Images

2019-04-17 · CVPR 2019 6 · Junsik Kim, Tae-Hyun Oh, Seokju Lee, Fei Pan 외

In daily life, graphic symbols, such as traffic signs and brand logos, are ubiquitously utilized around us due to its intuitive expression beyond language boundary. We tackle an open-set graphic symbol recognition proble…

Metric LearningOne-Shot LearningTranslation

Interpretable Time-series Classification on Few-shot Samples

2020-06-03 · Wensi Tang, Lu Liu, Guodong Long

Recent few-shot learning works focus on training a model with prior meta-knowledge to fast adapt to new tasks with unseen classes and samples. However, conventional time-series classification algorithms fail to tackle th…

ClassificationFew-Shot LearningGeneral ClassificationTime Series+2

PIP-Net: Patch-Based Intuitive Prototypes for Interpretable Image Classification

2023-01-01 · CVPR 2023 1 · Meike Nauta, Jörg Schlötterer, Maurice van Keulen, Christin Seifert

Interpretable methods based on prototypical patches recognize various components in an image in order to explain their reasoning to humans. However, existing prototype-based methods can learn prototypes that are not …

Decision Makingimage-classificationImage Classification