Learning Lexical Subspaces in a Distributional Vector Space
In this paper, we propose LexSub, a novel approach towards unifying lexical and distributional semantics. We inject knowledge about lexical-semantic relations into distributional word embeddings by defining subspaces of the distributional vector space in which a lexical relation should hold. Our framework can handle symmetric attract and repel relations (e.g., synonymy and antonymy, respectively), as well as asymmetric relations (e.g., hypernymy and meronomy). In a suite of intrinsic benchmarks, we show that our model outperforms previous approaches on relatedness tasks and on hypernymy classification and detection, while being competitive on word similarity tasks. It also outperforms previous systems on extrinsic classification tasks that benefit from exploiting lexical relational cues. We perform a series of analyses to understand the behaviors of our model.1Code available at https://github.com/aishikchakraborty/LexSub.
Code (1)
Tasks
General ClassificationWord EmbeddingsWord SimilaritySimilar Papers 제목 키워드 기반
Discovering Stylistic Variations in Distributional Vector Space Models via Lexical Paraphrases
Detecting and analyzing stylistic variation in language is relevant to diverse Natural Language Processing applications. In this work, we investigate whether salient dimensions of style variations are embedded in standar…
Semantic Textual SimilarityWord EmbeddingsGeneralized Tuning of Distributional Word Vectors for Monolingual and Cross-Lingual Lexical Entailment
Lexical entailment (LE; also known as hyponymy-hypernymy or is-a relation) is a core asymmetric lexical relation that supports tasks like taxonomy induction and text generation. In this work, we propose a simple and effe…
Lexical EntailmentRelationText GenerationAdversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specialization
Semantic specialization is the process of fine-tuning pre-trained distributional word vectors using external lexical knowledge (e.g., WordNet) to accentuate a particular semantic relation in the specialized vector space.…
Cross-Lingual Transferdialog state trackingLexical SimplificationWord Similarity+1Distributional Sentence Entailment Using Density Matrices
Categorical compositional distributional model of Coecke et al. (2010) suggests a way to combine grammatical composition of the formal, type logical models with the corpus based, empirical word representations of distrib…
Lexical EntailmentSentenceExplicit Retrofitting of Distributional Word Vectors
Semantic specialization of distributional word vectors, referred to as retrofitting, is a process of fine-tuning word vectors using external lexical knowledge in order to better embed some semantic relation. Existing ret…
dialog state trackingLexical SimplificationSemantic Textual SimilarityText Simplification+1