paper-with-me

Papers

Learning to Explain: Prototype-Based Surrogate Models for LLM Classification

2025-05-25 · Bowen Wei, Ziwei Zhu

Large language models (LLMs) have demonstrated impressive performance on natural language tasks, but their decision-making processes remain largely opaque. Existing explanation methods either suffer from limited faithfulness to the model's reasoning or produce explanations that humans find difficult to understand. To address these challenges, we propose \textbf{ProtoSurE}, a novel prototype-based surrogate framework that provides faithful and human-understandable explanations for LLMs. ProtoSurE trains an interpretable-by-design surrogate model that aligns with the target LLM while utilizing sentence-level prototypes as human-understandable concepts. Extensive experiments show that ProtoSurE consistently outperforms SOTA explanation methods across diverse LLMs and datasets. Importantly, ProtoSurE demonstrates strong data efficiency, requiring relatively few training examples to achieve good performance, making it practical for real-world applications.

📄 PDF Abstract BibTeX arXiv:2505.18970

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingSentence

Similar Papers 제목 키워드 기반

Enhanced Prototypical Part Network (EPPNet) For Explainable Image Classification Via Prototypes

2024-08-08 · Bhushan Atote, Victor Sanchez

Explainable Artificial Intelligence (xAI) has the potential to enhance the transparency and trust of AI-based systems. Although accurate predictions can be made using Deep Neural Networks (DNNs), the process used to arri…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)image-classificationImage Classification

This Looks Like That, Because ... Explaining Prototypes for Interpretable Image Recognition

2020-11-05 · Meike Nauta, Annemarie Jutte, Jesper Provoost, Christin Seifert

Image recognition with prototypes is considered an interpretable alternative for black box deep learning models. Classification depends on the extent to which a test image "looks like" a prototype. However, perceptual si…

ClassificationGeneral Classification

ProtoTEx: Explaining Model Decisions with Prototype Tensors

2022-04-11 · ACL 2022 5 · Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease 외

We present ProtoTEx, a novel white-box NLP classification architecture based on prototype networks. ProtoTEx faithfully explains model decisions based on prototype tensors that encode latent clusters of training examples…

modelPropaganda detection

Explaining Deep Classification of Time-Series Data with Learned Prototypes

2019-04-18 · Alan H. Gee, Diego Garcia-Olano, Joydeep Ghosh, David Paydarfar

The emergence of deep learning networks raises a need for explainable AI so that users and domain experts can be confident applying them to high-risk decisions. In this paper, we leverage data from the latent space induc…

ClassificationDecision MakingGeneral ClassificationTime Series+1

Post-hoc Part-prototype Networks

2024-06-05 · Andong Tan, Fengtao Zhou, Hao Chen

Post-hoc explainability methods such as Grad-CAM are popular because they do not influence the performance of a trained model. However, they mainly reveal "where" a model looks at for a given input, fail to explain "what…