Word Sense Filtering Improves Embedding-Based Lexical Substitution
The role of word sense disambiguation in lexical substitution has been questioned due to the high performance of vector space models which propose good substitutes without explicitly accounting for sense. We show that a filtering mechanism based on a sense inventory optimized for substitutability can improve the results of these models. Our sense inventory is constructed using a clustering method which generates paraphrase clusters that are congruent with lexical substitution annotations in a development set. The results show that lexical substitution can still benefit from senses which can improve the output of vector space paraphrase ranking models.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringEntity Extraction using GANPart-Of-Speech TaggingSemantic Textual SimilaritySentiment AnalysisWord EmbeddingsWord Sense DisambiguationSimilar Papers 제목 키워드 기반
Simple Embedding-Based Word Sense Disambiguation
We present a simple knowledge-based WSD method that uses word and sense embeddings to compute the similarity between the gloss of a sense and the context of the word. Our method is inspired by the Lesk algorithm as it ex…
Word Sense DisambiguationBest of Both Worlds: Making Word Sense Embeddings Interpretable
Word sense embeddings represent a word sense as a low-dimensional numeric vector. While this representation is potentially useful for NLP applications, its interpretability is inherently limited. We propose a simple tech…
Polysemanticity or Polysemy? Lexical Identity Confounds Superposition Metrics
If the same neuron activates for both "lender" and "riverside," standard metrics attribute the overlap to superposition--the neuron must be compressing two unrelated concepts. This work explores how much of the overlap i…
Word Sense DisambiguationAutomatically Linking Lexical Resources with Word Sense Embedding Models
Automatically learnt word sense embeddings are developed as an attempt to refine the capabilities of coarse word embeddings. The word sense representations obtained this way are, however, sensitive to underlying corpora …
Word EmbeddingsDiaSense at SemEval-2020 Task 1: Modeling Sense Change via Pre-trained BERT Embeddings
This paper describes DiaSense, a system developed for Task 1 {`}Unsupervised Lexical Semantic Change Detection{'} of SemEval 2020. In DiaSense, contextualized word embeddings are used to model word sense changes. This al…
Change DetectionWord Embeddings