Text Similarity Estimation Based on Word Embeddings and Matrix Norms for Targeted Marketing
The prevalent way to estimate the similarity of two documents based on word embeddings is to apply the cosine similarity measure to the two centroids obtained from the embedding vectors associated with the words in each document. Motivated by an industrial application from the domain of youth marketing, where this approach produced only mediocre results, we propose an alternative way of combining the word vectors using matrix norms. The evaluation shows superior results for most of the investigated matrix norms in comparison to both the classical cosine measure and several other document similarity estimates.
Code (0)
등록된 구현이 없습니다.
Tasks
Marketingtext similarityWord EmbeddingsSimilar Papers 제목 키워드 기반
Solving Cosine Similarity Underestimation between High Frequency Words by L2 Norm Discounting
Cosine similarity between two words, computed using their contextualised token embeddings obtained from masked language models (MLMs) such as BERT has shown to underestimate the actual similarity between those words (Zho…
Word SimilarityContext-Aware Cross-Lingual Mapping
Cross-lingual word vectors are typically obtained by fitting an orthogonal matrix that maps the entries of a bilingual dictionary from a source to a target vector space. Word vectors, however, are most commonly used for …
RetrievalSentenceSentence EmbeddingsTranslation+2Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words
Cosine similarity of contextual embeddings is used in many NLP tasks (e.g., QA, IR, MT) and metrics (e.g., BERTScore). Here, we uncover systematic ways in which word similarities estimated by cosine over BERT embeddings …
Utilizing Embeddings for Ad-hoc Retrieval by Document-to-document Similarity
Latent semantic representations of words or paragraphs, namely the embeddings, have been widely applied to information retrieval (IR). One of the common approaches of utilizing embeddings for IR is to estimate the docume…
Document RankingInformation RetrievalRetrievalGeneralised Spherical Text Embedding
This paper aims to provide an unsupervised modelling approach that allows for a more flexible representation of text embeddings. It jointly encodes the words and the paragraphs as individual matrices of arbitrary column …
ClusteringDocument ClassificationSemantic Textual Similarity