Embedding Semantic Relations into Word Representations
Learning representations for semantic relations is important for various tasks such as analogy detection, relational search, and relation classification. Although there have been several proposals for learning representations for individual words, learning word representations that explicitly capture the semantic relations between words remains under developed. We propose an unsupervised method for learning vector representations for words such that the learnt representations are sensitive to the semantic relations that exist between two words. First, we extract lexical patterns from the co-occurrence contexts of two words in a corpus to represent the semantic relations that exist between those two words. Second, we represent a lexical pattern as the weighted sum of the representations of the words that co-occur with that lexical pattern. Third, we train a binary classifier to detect relationally similar vs. non-similar lexical pattern pairs. The proposed method is unsupervised in the sense that the lexical pattern pairs we use as train data are automatically sampled from a corpus, without requiring any manual intervention. Our proposed method statistically significantly outperforms the current state-of-the-art word representations on three benchmark datasets for proportional analogy detection, demonstrating its ability to accurately capture the semantic relations among words.
Code (0)
등록된 구현이 없습니다.
Tasks
Relation ClassificationSimilar Papers 제목 키워드 기반
Enhancing Semantic Word Representations by Embedding Deeper Word Relationships
Word representations are created using analogy context-based statistics and lexical relations on words. Word representations are inputs for the learning models in Natural Language Understanding (NLU) tasks. However, to u…
Natural Language UnderstandingIRB-NLP at SemEval-2022 Task 1: Exploring the Relationship Between Words and Their Semantic Representations
What is the relation between a word and its description, or a word and its embedding? Both descriptions and embeddings are semantic representations of words. But, what information from the original word remains in these …
DescriptiveReverse DictionaryWord EmbeddingsOn the Effects of Knowledge-Augmented Data in Word Embeddings
This paper investigates techniques for knowledge injection into word embeddings learned from large corpora of unannotated data. These representations are trained with word cooccurrence statistics and do not commonly expl…
Data Augmentationtext-classificationText ClassificationWord EmbeddingsA Comprehensive Empirical Evaluation of Existing Word Embedding Approaches
Vector-based word representations help countless Natural Language Processing (NLP) tasks capture the language's semantic and syntactic regularities. In this paper, we present the characteristics of existing word embeddin…
Towards a Theoretical Understanding of Word and Relation Representation
Representing words by vectors, or embeddings, enables computational reasoning and is foundational to automating natural language tasks. For example, if word embeddings of similar words contain similar values, word simila…
Knowledge GraphsRelationWord EmbeddingsWord Similarity