paper-with-me

홈 › Papers

Modeling Semantic Relatedness using Global Relation Vectors

2017-11-14 · Shoaib Jameel, Zied Bouraoui, Steven Schockaert

Word embedding models such as GloVe rely on co-occurrence statistics from a large corpus to learn vector representations of word meaning. These vectors have proven to capture surprisingly fine-grained semantic and syntactic information. While we may similarly expect that co-occurrence statistics can be used to capture rich information about the relationships between different words, existing approaches for modeling such relationships have mostly relied on manipulating pre-trained word vectors. In this paper, we introduce a novel method which directly learns relation vectors from co-occurrence statistics. To this end, we first introduce a variant of GloVe, in which there is an explicit connection between word vectors and PMI weighted co-occurrence vectors. We then show how relation vectors can be naturally embedded into the resulting vector space.

📄 PDF Abstract BibTeX arXiv:1711.05294

Code (0)

등록된 구현이 없습니다.

Tasks

Relation

Methods 이 논문이 사용한 방법론

GloVe GloVe Embeddings are a type of word embedding that encode the co-occurrence probability ratio between two words as vector differences. GloVe uses a weighted least squares…

Similar Papers 제목 키워드 기반

A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts

2021-01-25 · Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha

Objective: This work aimed to demonstrate the effectiveness of a hybrid approach based on Sentence BERT model and retrofitting algorithm to compute relatedness between any two biomedical concepts. Materials and Methods: …

Sentence

Leveraging Deep Neural Networks and Knowledge Graphs for Entity Disambiguation

2015-04-28 · Hongzhao Huang, Larry Heck, Heng Ji

Entity Disambiguation aims to link mentions of ambiguous entities to a knowledge base (e.g., Wikipedia). Modeling topical coherence is crucial for this task based on the assumption that information from the same semantic…

Entity DisambiguationKnowledge Graphs

Improving Correlation with Human Judgments by Integrating Semantic Similarity with Second--Order Vectors

2016-09-02 · WS 2017 8 · Bridget T. McInnes, Ted Pedersen

Vector space methods that measure semantic similarity and relatedness often rely on distributional information such as co--occurrence frequencies or statistical measures of association to weight the importance of particu…

Semantic SimilaritySemantic Textual Similarity

Learning Thesaurus Relations from Distributional Features

2016-05-01 · LREC 2016 5 · Rosa Tsegaye Aga, Christian Wartena, Lucas Drumond, Lars Schmidt-Thieme

In distributional semantics words are represented by aggregated context features. The similarity of words can be computed by comparing their feature vectors. Thus, we can predict whether two words are synonymous or simil…

Document ClassificationRelation

From the New World of Word Embeddings: A Comparative Study of Small-World Lexico-Semantic Networks in LLMs

2025-02-17 · Zhu Liu, Ying Liu, Kangyang Luo, Cunliang Kong 외

Lexico-semantic networks represent words as nodes and their semantic relatedness as edges. While such networks are traditionally constructed using embeddings from encoder-based models or static vectors, embeddings from d…

DecoderWord Embeddings