paper-with-me

홈 › Papers

Embedding Semantic Relations into Word Representations

2015-05-01 · Danushka Bollegala, Takanori Maehara, Ken-ichi Kawarabayashi

Learning representations for semantic relations is important for various tasks such as analogy detection, relational search, and relation classification. Although there have been several proposals for learning representations for individual words, learning word representations that explicitly capture the semantic relations between words remains under developed. We propose an unsupervised method for learning vector representations for words such that the learnt representations are sensitive to the semantic relations that exist between two words. First, we extract lexical patterns from the co-occurrence contexts of two words in a corpus to represent the semantic relations that exist between those two words. Second, we represent a lexical pattern as the weighted sum of the representations of the words that co-occur with that lexical pattern. Third, we train a binary classifier to detect relationally similar vs. non-similar lexical pattern pairs. The proposed method is unsupervised in the sense that the lexical pattern pairs we use as train data are automatically sampled from a corpus, without requiring any manual intervention. Our proposed method statistically significantly outperforms the current state-of-the-art word representations on three benchmark datasets for proportional analogy detection, demonstrating its ability to accurately capture the semantic relations among words.

📄 PDF Abstract BibTeX arXiv:1505.00161

Code (0)

등록된 구현이 없습니다.

Tasks

Relation Classification

Similar Papers 제목 키워드 기반

Enhancing Semantic Word Representations by Embedding Deeper Word Relationships

2019-01-22 · Anupiya Nugaliyadde, Kok Wai Wong, Ferdous Sohel, Hong Xie

Word representations are created using analogy context-based statistics and lexical relations on words. Word representations are inputs for the learning models in Natural Language Understanding (NLU) tasks. However, to u…

Natural Language Understanding

IRB-NLP at SemEval-2022 Task 1: Exploring the Relationship Between Words and Their Semantic Representations

2022-05-13 · SemEval (NAACL) 2022 7 · Damir Korenčić, Ivan Grubišić

What is the relation between a word and its description, or a word and its embedding? Both descriptions and embeddings are semantic representations of words. But, what information from the original word remains in these …

DescriptiveReverse DictionaryWord Embeddings

On the Effects of Knowledge-Augmented Data in Word Embeddings

2020-10-05 · Diego Ramirez-Echavarria, Antonis Bikakis, Luke Dickens, Rob Miller 외

This paper investigates techniques for knowledge injection into word embeddings learned from large corpora of unannotated data. These representations are trained with word cooccurrence statistics and do not commonly expl…

Data Augmentationtext-classificationText ClassificationWord Embeddings

A Comprehensive Empirical Evaluation of Existing Word Embedding Approaches

2023-03-13 · Obaidullah Zaland, Muhammad Abulaish, Mohd. Fazil

Vector-based word representations help countless Natural Language Processing (NLP) tasks capture the language's semantic and syntactic regularities. In this paper, we present the characteristics of existing word embeddin…

Towards a Theoretical Understanding of Word and Relation Representation

2022-02-01 · Carl Allen

Representing words by vectors, or embeddings, enables computational reasoning and is foundational to automating natural language tasks. For example, if word embeddings of similar words contain similar values, word simila…

Knowledge GraphsRelationWord EmbeddingsWord Similarity