Word Sense Disambiguation using a Bidirectional LSTM
In this paper we present a clean, yet effective, model for word sense disambiguation. Our approach leverage a bidirectional long short-term memory network which is shared between all words. This enables the model to share statistical strength and to scale well with vocabulary size. The model is trained end-to-end, directly from the raw text to sense labels, and makes effective use of word order. We evaluate our approach on two standard datasets, using identical hyperparameter settings, which are in turn tuned on a third set of held out data. We employ no external resources (e.g. knowledge graphs, part-of-speech tagging, etc), language specific features, or hand crafted rules, but still achieve statistically equivalent results to the best state-of-the-art systems, that employ no such limitations.
Code (1)
Tasks
Word Sense DisambiguationSimilar Papers 제목 키워드 기반
One Single Deep Bidirectional LSTM Network for Word Sense Disambiguation of Text Data
Due to recent technical and scientific advances, we have a wealth of information hidden in unstructured text data such as offline/online narratives, research articles, and clinical reports. To mine these data properly, a…
ArticlesWord Sense DisambiguationSensPick: Sense Picking for Word Sense Disambiguation
Word sense disambiguation (WSD) methods identify the most suitable meaning of a word with respect to the usage of that word in a specific context. Neural network-based WSD approaches rely on a sense-annotated corpus sinc…
PositionWord Sense DisambiguationSemi-supervised Word Sense Disambiguation with Neural Models
Determining the intended sense of words in text - word sense disambiguation (WSD) - is a long standing problem in natural language processing. Recently, researchers have shown promising results using word vectors extract…
Language ModelingLanguage ModellingWord Sense DisambiguationQuasi Bidirectional Encoder Representations from Transformers for Word Sense Disambiguation
While contextualized embeddings have produced performance breakthroughs in many Natural Language Processing (NLP) tasks, Word Sense Disambiguation (WSD) has not benefited from them yet. In this paper, we introduce QBERT,…
Word Sense DisambiguationWord Sense Disambiguation with LSTM: Do We Really Need 100 Billion Words?
Recently, Yuan et al. (2016) have shown the effectiveness of using Long Short-Term Memory (LSTM) for performing Word Sense Disambiguation (WSD). Their proposed technique outperformed the previous state-of-the-art with se…
Word Sense Disambiguation