Evaluating the Utility of Document Embedding Vector Difference for Relation Learning
Recent work has demonstrated that vector offsets obtained by subtracting pretrained word embedding vectors can be used to predict lexical relations with surprising accuracy. Inspired by this finding, in this paper, we extend the idea to the document level, in generating document-level embeddings, calculating the distance between them, and using a linear classifier to classify the relation between the documents. In the context of duplicate detection and dialogue act tagging tasks, we show that document-level difference vectors have utility in assessing document-level similarity, but perform less well in multi-relational classification.
Code (0)
등록된 구현이 없습니다.
Tasks
Document EmbeddingRelationSimilar Papers 제목 키워드 기반
Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learning
Recent work on word embeddings has shown that simple vector subtraction over pre-trained embeddings is surprisingly effective at capturing different lexical relations, despite lacking explicit supervision. Prior work has…
ClusteringRelationWord EmbeddingsRepresenting Mixtures of Word Embeddings with Mixtures of Topic Embeddings
A topic model is often formulated as a generative model that explains how each word of a document is generated given a set of topics and document-specific topic proportions. It is focused on capturing the word co-occurre…
parameter estimationWord EmbeddingsShadow Queries for Private Retrieval in Vector Databases
Large language models (LLMs) increasingly rely on information retrieval (IR) systems, such as Retrieval-Augmented Generation (RAG), to incorporate domain-specific knowledge without costly re-training. These systems often…
Information RetrievalVector of Locally-Aggregated Word Embeddings (VLAWE): A Novel Document-level Representation
In this paper, we propose a novel representation for text documents based on aggregating word embedding vectors into document embeddings. Our approach is inspired by the Vector of Locally-Aggregated Descriptors used for …
Multi-Label Text ClassificationSentiment AnalysisSubjectivity Analysistext-classification+2Dirichlet-vMF Mixture Model
This document is about the multi-document Von-Mises-Fisher mixture model with a Dirichlet prior, referred to as VMFMix. VMFMix is analogous to Latent Dirichlet Allocation (LDA) in that they can capture the co-occurrence …
Document ClassificationGeneral Classificationmodel