ConSeC: Word Sense Disambiguation as Continuous Sense Comprehension
Supervised systems have nowadays become the standard recipe for Word Sense Disambiguation (WSD), with Transformer-based language models as their primary ingredient. However, while these systems have certainly attained unprecedented performances, virtually all of them operate under the constraining assumption that, given a context, each word can be disambiguated individually with no account of the other sense choices. To address this limitation and drop this assumption, we propose CONtinuous SEnse Comprehension (ConSeC), a novel approach to WSD: leveraging a recent re-framing of this task as a text extraction problem, we adapt it to our formulation and introduce a feedback loop strategy that allows the disambiguation of a target word to be conditioned not only on its context but also on the explicit senses assigned to nearby words. We evaluate ConSeC and examine how its components lead it to surpass all its competitors and set a new state of the art on English WSD. We also explore how ConSeC fares in the cross-lingual setting, focusing on 8 languages with various degrees of resource availability, and report significant improvements over prior systems. We release our code at https://github.com/SapienzaNLP/consec.
Code (1)
Tasks
Word Sense DisambiguationSimilar Papers 제목 키워드 기반
A Novel Word Sense Disambiguation Approach Using WordNet Knowledge Graph
Various applications in computational linguistics and artificial intelligence rely on high-performing word sense disambiguation techniques to solve challenging tasks such as information retrieval, machine translation, qu…
ClusteringInformation RetrievalMachine TranslationQuestion Answering+7Zero-shot Word Sense Disambiguation using Sense Definition Embeddings
Word Sense Disambiguation (WSD) is a long-standing but open problem in Natural Language Processing (NLP). WSD corpora are typically small in size, owing to an expensive annotation process. Current supervised WSD methods …
Generalized Zero-Shot LearningGraph EmbeddingKnowledge Graph EmbeddingSentence+2A Quadratic 0-1 Programming Approach for Word Sense Disambiguation
Word Sense Disambiguation (WSD) is the task to determine the sense of an ambiguous word in a given context. Previous approaches for WSD have focused on supervised and knowledge-based methods, but inter-sense interactions…
Combinatorial OptimizationWord Sense DisambiguationWord SimilarityChinese Word Sense Embedding with SememeWSD and Synonym Set
Word embedding is a fundamental natural language processing task which can learn feature of words. However, most word embedding methods assign only one vector to a word, even if polysemous words have multi-senses. To add…
Semantic SimilaritySemantic Textual SimilarityWord Sense DisambiguationMoving Down the Long Tail of Word Sense Disambiguation with Gloss-Informed Biencoders
A major obstacle in Word Sense Disambiguation (WSD) is that word senses are not uniformly distributed, causing existing models to generally perform poorly on senses that are either rare or unseen during training. We prop…
Word Sense Disambiguation