paper-with-me

홈 › Papers

Applied Explainability for Large Language Models: A Comparative Study

2026-04-15 · Venkata Abhinandan Kancharla arxiv

Large language models (LLMs) achieve strong performance across many natural language processing tasks, yet their decision processes remain difficult to interpret. This lack of transparency creates challenges for trust, debugging, and deployment in real-world systems. This paper presents an applied comparative study of three explainability techniques: Integrated Gradients, Attention Rollout, and SHAP, on a fine-tuned DistilBERT model for SST-2 sentiment classification. Rather than proposing new methods, the focus is on evaluating the practical behavior of existing approaches under a consistent and reproducible setup. The results show that gradient-based attribution provides more stable and intuitive explanations, while attention-based methods are computationally efficient but less aligned with prediction-relevant features. Model-agnostic approaches offer flexibility but introduce higher computational cost and variability. This work highlights key trade-offs between explainability methods and emphasizes their role as diagnostic tools rather than definitive explanations. The findings provide practical insights for researchers and engineers working with transformer-based NLP systems. This is a preprint and has not undergone peer review.

📄 PDF Abstract BibTeX arXiv:2604.15371

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Comparative Study of Language Models on Cross-Domain Data with Model Agnostic Explainability

2020-09-09 · Mayank Chhipa, Hrushikesh Mahesh Vazurkar, Abhijeet Kumar, Mridul Mishra

With the recent influx of bidirectional contextualized transformer language models in the NLP, it becomes a necessity to have a systematic comparative study of these models on variety of datasets. Also, the performance o…

Language ModelingLanguage Modelling

Comparing Post-Hoc Explainable AI Methods for Interpreting Black-Box EEG Models in Depression Detection

2026-05-27 · Antonia Šarčević, Nikolina Frid arxiv

Recent advances in deep learning have enabled increasingly accurate electroencephalography (EEG)-based classification of Major Depressive Disorder (MDD), but the decision-making processes of high-capacity models remain d…

Feature Importance

Model Explainability in Deep Learning Based Natural Language Processing

2021-06-14 · Shafie Gholizadeh, Nengfeng Zhou

Machine learning (ML) model explainability has received growing attention, especially in the area related to model risk and regulations. In this paper, we reviewed and compared some popular ML model explainability method…

Deep Learning

Building Trustworthy Multimodal AI: A Review of Fairness, Transparency, and Ethics in Vision-Language Tasks

2025-04-14 · Mohammad Saleh, Azadeh Tabatabaei

Objective: This review explores the trustworthiness of multimodal artificial intelligence (AI) systems, specifically focusing on vision-language tasks. It addresses critical challenges related to fairness, transparency, …

EthicsFairnessImage CaptioningQuestion Answering+2

A Comparative Study of Lexical Substitution Approaches based on Neural Language Models

2020-05-29 · Nikolay Arefyev, Boris Sheludko, Alexander Podolskiy, Alexander Panchenko

Lexical substitution in context is an extremely powerful technology that can be used as a backbone of various NLP applications, such as word sense induction, lexical relation extraction, data augmentation, etc. In this p…

Data AugmentationRelation ExtractionWord Sense Induction