Interpretable Text Embeddings and Text Similarity Explanation: A Primer
Text embeddings and text embedding models are a backbone of many AI and NLP systems, particularly those involving search. However, interpretability challenges persist, especially in explaining obtained similarity scores, which is crucial for applications requiring transparency. In this paper, we give a structured overview of interpretability methods specializing in explaining those similarity scores, an emerging research area. We study the methods' individual ideas and techniques, evaluating their potential for improving interpretability of text embeddings and explaining predicted similarities.
Code (0)
등록된 구현이 없습니다.
Tasks
Similarity Explanationtext similaritySimilar Papers 제목 키워드 기반
QIME: Constructing Interpretable Medical Text Embeddings via Ontology-Grounded Questions
While dense biomedical embeddings achieve strong performance, their black-box nature limits their utility in clinical decision-making. Recent question-based interpretable embeddings represent text as binary answers to na…
Semantic SimilarityPEACH: Pretrained-embedding Explanation Across Contextual and Hierarchical Structure
In this work, we propose a novel tree-based explanation technique, PEACH (Pretrained-embedding Explanation Across Contextual and Hierarchical Structure), that can explain how text-based documents are classified by using …
Attributefeature selectiontext-classificationText ClassificationInterpretable Company Similarity with Sparse Autoencoders
Determining company similarity is a vital task in finance, underpinning risk management, hedging, and portfolio diversification. Practitioners often rely on sector and industry classifications such as SIC and GICS codes …
Large Language ModelSemantic SimilaritySemantic Textual SimilarityContext Embedding Networks
Low dimensional embeddings that capture the main variations of interest in collections of data are important for many applications. One way to construct these embeddings is to acquire estimates of similarity from the cro…
LDIR: Low-Dimensional Dense and Interpretable Text Embeddings with Relative Representations
Semantic text representation is a fundamental task in the field of natural language processing. Existing text embedding (e.g., SimCSE and LLM2Vec) have demonstrated excellent performance, but the values of each dimension…
Semantic Textual Similarity