Modeling Semantic Relatedness using Global Relation Vectors
Word embedding models such as GloVe rely on co-occurrence statistics from a large corpus to learn vector representations of word meaning. These vectors have proven to capture surprisingly fine-grained semantic and syntactic information. While we may similarly expect that co-occurrence statistics can be used to capture rich information about the relationships between different words, existing approaches for modeling such relationships have mostly relied on manipulating pre-trained word vectors. In this paper, we introduce a novel method which directly learns relation vectors from co-occurrence statistics. To this end, we first introduce a variant of GloVe, in which there is an explicit connection between word vectors and PMI weighted co-occurrence vectors. We then show how relation vectors can be naturally embedded into the resulting vector space.
Code (0)
등록된 구현이 없습니다.
Tasks
RelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts
Objective: This work aimed to demonstrate the effectiveness of a hybrid approach based on Sentence BERT model and retrofitting algorithm to compute relatedness between any two biomedical concepts. Materials and Methods: …
SentenceLeveraging Deep Neural Networks and Knowledge Graphs for Entity Disambiguation
Entity Disambiguation aims to link mentions of ambiguous entities to a knowledge base (e.g., Wikipedia). Modeling topical coherence is crucial for this task based on the assumption that information from the same semantic…
Entity DisambiguationKnowledge GraphsImproving Correlation with Human Judgments by Integrating Semantic Similarity with Second--Order Vectors
Vector space methods that measure semantic similarity and relatedness often rely on distributional information such as co--occurrence frequencies or statistical measures of association to weight the importance of particu…
Semantic SimilaritySemantic Textual SimilarityLearning Thesaurus Relations from Distributional Features
In distributional semantics words are represented by aggregated context features. The similarity of words can be computed by comparing their feature vectors. Thus, we can predict whether two words are synonymous or simil…
Document ClassificationRelationFrom the New World of Word Embeddings: A Comparative Study of Small-World Lexico-Semantic Networks in LLMs
Lexico-semantic networks represent words as nodes and their semantic relatedness as edges. While such networks are traditionally constructed using embeddings from encoder-based models or static vectors, embeddings from d…
DecoderWord Embeddings