Structural Regularities in Text-based Entity Vector Spaces
Entity retrieval is the task of finding entities such as people or products in response to a query, based solely on the textual documents they are associated with. Recent semantic entity retrieval algorithms represent queries and experts in finite-dimensional vector spaces, where both are constructed from text sequences. We investigate entity vector spaces and the degree to which they capture structural regularities. Such vector spaces are constructed in an unsupervised manner without explicit information about structural aspects. For concreteness, we address these questions for a specific type of entity: experts in the context of expert finding. We discover how clusterings of experts correspond to committees in organizations, the ability of expert representations to encode the co-author graph, and the degree to which they encode academic rank. We compare latent, continuous representations created using methods based on distributional semantics (LSI), topic models (LDA) and neural networks (word2vec, doc2vec, SERT). Vector spaces created using neural methods, such as doc2vec and SERT, systematically perform better at clustering than LSI, LDA and word2vec. When it comes to encoding entity relations, SERT performs best.
Code (1)
Tasks
ClusteringEntity RetrievalRetrievalTopic ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sentence Analogies: Linguistic Regularities in Sentence Embeddings
While important properties of word vector representations have been studied extensively, far less is known about the properties of sentence vector representations. Word vectors are often evaluated by assessing to what de…
SentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsSentence Analogies: Exploring Linguistic Relationships and Regularities in Sentence Embeddings
While important properties of word vector representations have been studied extensively, far less is known about the properties of sentence vector representations. Word vectors are often evaluated by assessing to what de…
SentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsIs Aligning Embedding Spaces a Challenging Task? A Study on Heterogeneous Embedding Alignment Methods
Representation Learning of words and Knowledge Graphs (KG) into low dimensional vector spaces along with its applications to many real-world scenarios have recently gained momentum. In order to make use of multiple KG em…
Entity DisambiguationKnowledge Graph CompletionKnowledge GraphsQuestion Answering+1RiemanLine: Riemannian Manifold Representation of 3D Lines for Factor Graph Optimization
Minimal parametrization of 3D lines plays a critical role in camera localization and structural mapping. Existing representations in robotics and computer vision predominantly handle independent lines, overlooking struct…
Camera LocalizationPose EstimationExploiting Morphological Regularities in Distributional Word Representations
We present an unsupervised, language agnostic approach for exploiting morphological regularities present in high dimensional vector spaces. We propose a novel method for generating embeddings of words from their morpholo…
ChunkingDocument ClassificationQuestion AnsweringWord Embeddings