Explainability of Text Processing and Retrieval Methods: A Critical Survey
Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant body of research has focused on increasing the transparency of these models. This article provides a broad overview of research on the explainability and interpretability of natural language processing and information retrieval methods. More specifically, we survey approaches that have been applied to explain word embeddings, sequence modeling, attention modules, transformers, BERT, and document ranking. The concluding section suggests some possible directions for future research on this topic.
Code (0)
등록된 구현이 없습니다.
Tasks
Document RankingInformation RetrievalRetrievalSurveyWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RAIDX: A Retrieval-Augmented Generation and GRPO Reinforcement Learning Framework for Explainable Deepfake Detection
The rapid advancement of AI-generation models has enabled the creation of hyperrealistic imagery, posing ethical risks through widespread misinformation. Current deepfake detection methods, categorized as face specific d…
Reinforcement LearningDeepFake DetectionKGRAG-Ex: Explainable Retrieval-Augmented Generation with Knowledge Graph-based Perturbations
Retrieval-Augmented Generation (RAG) enhances language models by grounding responses in external information, yet explainability remains a critical challenge, particularly when retrieval relies on unstructured text. Know…
Information ExtractionKnowledge GraphsCombining Objective and Subjective Perspectives for Political News Understanding
Researchers and practitioners interested in computational politics rely on automatic content analysis tools to make sense of the large amount of political texts available on the Web. Such tools should provide objective a…
Information RetrievalA clinically motivated self-supervised approach for content-based image retrieval of CT liver images
Deep learning-based approaches for content-based image retrieval (CBIR) of CT liver images is an active field of research, but suffers from some critical limitations. First, they are heavily reliant on labeled data, whic…
Content-Based Image RetrievalImage RetrievalRepresentation LearningRetrieval+1Evaluating the Stability of Semantic Concept Representations in CNNs for Robust Explainability
Analysis of how semantic concepts are represented within Convolutional Neural Networks (CNNs) is a widely used approach in Explainable Artificial Intelligence (XAI) for interpreting CNNs. A motivation is the need for tra…
Dimensionality ReductionExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)object-detection+2