A Sense-Topic Model for Word Sense Induction with Unsupervised Data Enrichment
Word sense induction (WSI) seeks to automatically discover the senses of a word in a corpus via unsupervised methods. We propose a sense-topic model for WSI, which treats sense and topic as two separate latent variables to be inferred jointly. Topics are informed by the entire document, while senses are informed by the local context surrounding the ambiguous word. We also discuss unsupervised ways of enriching the original corpus in order to improve model performance, including using neural word embeddings and external corpora to expand the context of each data instance. We demonstrate significant improvements over the previous state-of-the-art, achieving the best results reported to date on the SemEval-2013 WSI task.
Code (0)
등록된 구현이 없습니다.
Tasks
Topic ModelsWord EmbeddingsWord Sense InductionSimilar Papers 제목 키워드 기반
AutoSense Model for Word Sense Induction
Word sense induction (WSI), or the task of automatically discovering multiple senses or meanings of a word, has three main challenges: domain adaptability, novel sense detection, and sense granularity flexibility. While …
modelWord Sense InductionEfficient Graph-based Word Sense Induction by Distributional Inclusion Vector Embeddings
Word sense induction (WSI), which addresses polysemy by unsupervised discovery of multiple word senses, resolves ambiguities for downstream NLP tasks and also makes word representations more interpretable. This paper pro…
Word Sense InductionUnsupervised Does Not Mean Uninterpretable: The Case for Word Sense Induction and Disambiguation
The current trend in NLP is the use of highly opaque models, e.g. neural networks and word embeddings. While these models yield state-of-the-art results on a range of tasks, their drawback is poor interpretability. On th…
Word EmbeddingsWord Sense DisambiguationWord Sense InductionTopological Data Analysis for Word Sense Disambiguation
We develop and test a novel unsupervised algorithm for word sense induction and disambiguation which uses topological data analysis. Typical approaches to the problem involve clustering, based on simple low level feature…
ClusteringTopological Data AnalysisWord EmbeddingsWord Sense Disambiguation+1