Towards Explainability in NLP: Analyzing and Calculating Word Saliency through Word Properties
The wide use of black-box models in natural language processing brings great challenges to the understanding of the decision basis, the trustworthiness of the prediction results, and the improvement of the model performance. The words in text samples have properties that reflect their semantics and contextual information, such as the part of speech, the position, etc. These properties may have certain relationships with the word saliency, which is of great help for studying the explainability of the model predictions. In this paper, we explore the relationships between the word saliency and the word properties. According to the analysis results, we further establish a mapping model, Seq2Saliency, from the words in a text sample and their properties to the saliency values based on the idea of sequence tagging. In addition, we establish a new dataset called PrSalM, which contains each word in the text samples, the word properties, and the word saliency values. The experimental evaluations are conducted to analyze the saliency of words with different properties. The effectiveness of the Seq2Saliency model is verified.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Medical Slice Transformer: Improved Diagnosis and Explainability on 3D Medical Images with DINOv2
MRI and CT are essential clinical cross-sectional imaging techniques for diagnosing complex conditions. However, large 3D datasets with annotations for deep learning are scarce. While methods like DINOv2 are encouraging …
ClassificationDiagnosticExplainable artificial intelligenceExplainable Models+2How Can One Choose the Best CAM-Based Explainability Method for a CNN Model?
In recent years, several advances have been observed in Deep Learning with surprising results. Models in this area have been increasingly used in numerous applications, including those sensitive to human life, which requ…
Concept Visualization: Explaining the CLIP Multi-modal Embedding Using WordNet
Advances in multi-modal embeddings, and in particular CLIP, have recently driven several breakthroughs in Computer Vision (CV). CLIP has shown impressive performance on a variety of tasks, yet, its inherently opaque arch…
Object LocalizationOut-of-Distribution DetectionA Diagnostic Study of Explainability Techniques for Text Classification
Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent …
ClassificationDiagnosticGeneral Classificationtext-classification+1Evaluation of Saliency-based Explainability Method
A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These met…
Explainable Artificial Intelligence (XAI)