Discriminating between Lexico-Semantic Relations with the Specialization Tensor Model
We present a simple and effective feed-forward neural architecture for discriminating between lexico-semantic relations (synonymy, antonymy, hypernymy, and meronymy). Our Specialization Tensor Model (STM) simultaneously produces multiple different specializations of input distributional word vectors, tailored for predicting lexico-semantic relations for word pairs. STM outperforms more complex state-of-the-art architectures on two benchmark datasets and exhibits stable performance across languages. We also show that, if coupled with a bilingual distributional space, the proposed model can transfer the prediction of lexico-semantic relations to a resource-lean target language without any training data.
Code (1)
Tasks
Natural Language InferenceParaphrase GenerationText SimplificationWord EmbeddingsSimilar Papers 제목 키워드 기반
Inverted Bilingual Topic Models for Lexicon Extraction from Non-parallel Data
Topic models have been successfully applied in lexicon extraction. However, most previous methods are limited to document-aligned data. In this paper, we try to address two challenges of applying topic models to lexicon …
Topic ModelsTranslationExplicit Retrofitting of Distributional Word Vectors
Semantic specialization of distributional word vectors, referred to as retrofitting, is a process of fine-tuning word vectors using external lexical knowledge in order to better embed some semantic relation. Existing ret…
dialog state trackingLexical SimplificationSemantic Textual SimilarityText Simplification+1LM-Lexicon: Improving Definition Modeling via Harmonizing Semantic Experts
We introduce LM-Lexicon, an innovative definition modeling approach that incorporates data clustering, semantic expert learning, and model merging using a sparse mixture-of-experts architecture. By decomposing the defini…
Joint Word Representation Learning using a Corpus and a Semantic Lexicon
Methods for learning word representations using large text corpora have received much attention lately due to their impressive performance in numerous natural language processing (NLP) tasks such as, semantic similarity …
Representation LearningSemantic SimilaritySemantic Textual SimilaritySentenceEnhancing Word Embeddings with Knowledge Extracted from Lexical Resources
In this work, we present an effective method for semantic specialization of word vector representations. To this end, we use traditional word embeddings and apply specialization methods to better capture semantic relatio…
dialog state trackingWord EmbeddingsWord Similarity