Antonym-Synonym Classification Based on New Sub-space Embeddings
Distinguishing antonyms from synonyms is a key challenge for many NLP applications focused on the lexical-semantic relation extraction. Existing solutions relying on large-scale corpora yield low performance because of huge contextual overlap of antonym and synonym pairs. We propose a novel approach entirely based on pre-trained embeddings. We hypothesize that the pre-trained embeddings comprehend a blend of lexical-semantic information and we may distill the task-specific information using Distiller, a model proposed in this paper. Later, a classifier is trained based on features constructed from the distilled sub-spaces along with some word level features to distinguish antonyms from synonyms. Experimental results show that the proposed model outperforms existing research on antonym synonym distinction in both speed and performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationRelation ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Antonymy-Synonymy Discrimination through the Repelling Parasiamese Neural Network
Antonymic and synonymic pairs may both occur nearby in word embeddings spaces because they have similar distributional information. Different methods have been used in order to distinguish antonyms from synonyms, making …
Word EmbeddingsCombining Discourse Markers and Cross-lingual Embeddings for Synonym--Antonym Classification
It is well-known that distributional semantic approaches have difficulty in distinguishing between synonyms and antonyms (Grefenstette, 1992; Pad{\'o} and Lapata, 2003). Recent work has shown that supervision available i…
Cross-Lingual Word EmbeddingsGeneral ClassificationWord EmbeddingsSemantic Word Clusters Using Signed Spectral Clustering
Vector space representations of words capture many aspects of word similarity, but such methods tend to produce vector spaces in which antonyms (as well as synonyms) are close to each other. For spectral clustering using…
ClusteringGraph ClusteringSemantic Textual SimilarityWord Embeddings+1Constructing a Corpus of Japanese Predicate Phrases for Synonym/Antonym Relations
We construct a large corpus of Japanese predicate phrases for synonym-antonym relations. The corpus consists of 7,278 pairs of predicates such as receive-permission (ACC) vs. obtain-permission (ACC), in which each pr…
Binary ClassificationGeneral ClassificationInformation RetrievalIntegrating Distributional Lexical Contrast into Word Embeddings for Antonym-Synonym Distinction
We propose a novel vector representation that integrates lexical contrast into distributional vectors and strengthens the most salient features for determining degrees of word similarity. The improved vectors significant…
Word EmbeddingsWord Similarity