Neural Sequence Learning Models for Word Sense Disambiguation
Word Sense Disambiguation models exist in many flavors. Even though supervised ones tend to perform best in terms of accuracy, they often lose ground to more flexible knowledge-based solutions, which do not require training by a word expert for every disambiguation target. To bridge this gap we adopt a different perspective and rely on sequence learning to frame the disambiguation problem: we propose and study in depth a series of end-to-end neural architectures directly tailored to the task, from bidirectional Long Short-Term Memory to encoder-decoder models. Our extensive evaluation over standard benchmarks and in multiple languages shows that sequence learning enables more versatile all-words models that consistently lead to state-of-the-art results, even against word experts with engineered features.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderInformation RetrievalMachine TranslationWord Sense DisambiguationSimilar Papers 제목 키워드 기반
A Quadratic 0-1 Programming Approach for Word Sense Disambiguation
Word Sense Disambiguation (WSD) is the task to determine the sense of an ambiguous word in a given context. Previous approaches for WSD have focused on supervised and knowledge-based methods, but inter-sense interactions…
Combinatorial OptimizationWord Sense DisambiguationWord SimilaritySupervised and Unsupervised Word Sense Disambiguation on Word Embedding Vectors of Unambigous Synonyms
This paper compares two approaches to word sense disambiguation using word embeddings trained on unambiguous synonyms. The first is unsupervised method based on computing log probability from sequences of word embedding …
Word EmbeddingsWord Sense DisambiguationParameter Transfer across Domains for Word Sense Disambiguation
Word sense disambiguation is defined as finding the corresponding sense for a target word in a given context, which comprises a major step in text applications. Recently, it has been addressed as an optimization problem.…
Lexical SimplificationMachine TranslationSemantic SimilaritySemantic Textual Similarity+1Estimating senses with sets of lexically related words for Polish word sense disambiguation
We propose a new algorithm for word sense disambiguation, exploiting data from a WordNet with many types of lexical relations, such as plWordNet for Polish. In this method, sense probabilities in context are approximated…
Language ModelingLanguage ModellingWord Sense DisambiguationAdapting BERT for Word Sense Disambiguation with Gloss Selection Objective and Example Sentences
Domain adaptation or transfer learning using pre-trained language models such as BERT has proven to be an effective approach for many natural language processing tasks. In this work, we propose to formulate word sense di…
Data AugmentationDomain AdaptationSentenceTransfer Learning+1