paper-with-me

Papers

One Classifier for All Ambiguous Words: Overcoming Data Sparsity by Utilizing Sense Correlations Across Words

2020-05-01 · LREC 2020 5 · Prafulla Kumar Choubey, Ruihong Huang

Most supervised word sense disambiguation (WSD) systems build word-specific classifiers by leveraging labeled data. However, when using word-specific classifiers, the sparseness of annotations leads to inferior sense disambiguation performance on less frequently seen words. To combat data sparsity, we propose to learn a single model that derives sense representations and meanwhile enforces congruence between a word instance and its right sense by using both sense-annotated data and lexical resources. The model is shared across words that allows utilizing sense correlations across words, and therefore helps to transfer common disambiguation rules from annotation-rich words to annotation-lean words. Empirical evaluation on benchmark datasets shows that the proposed shared model outperforms the equivalent classifier-based models by 1.7{\%}, 2.5{\%} and 3.8{\%} in F1-score when using GloVe, ELMo and BERT word embeddings respectively.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

AllWord EmbeddingsWord Sense Disambiguation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Sigmoid Activation 설명 없음
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Tanh Activation 설명 없음
Adam 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

On Stopwords, Filtering and Data Sparsity for Sentiment Analysis of Twitter

2014-05-01 · LREC 2014 5 · Hassan Saif, Fern, Miriam ez, Yulan He 외

Sentiment classification over Twitter is usually affected by the noisy nature (abbreviations, irregular forms) of tweets data. A popular procedure to reduce the noise of textual data is to remove stopwords by using pre-c…

ClassificationDocument ClassificationGeneral ClassificationSentiment Analysis+3

A method to identify potential ambiguous Malay words through Ambiguity Attributes mapping: An exploratory Study

2014-02-27 · Hazlina Haron, Abdul Azim Abd. Ghani

We describe here a methodology to identify a list of ambiguous Malay words that are commonly being used in Malay documentations such as Requirement Specification. We compiled several relevant and appropriate requirement …

Sentence

How big is big enough? Unsupervised word sense disambiguation using a very large corpus

2017-10-22 · Piotr Przybyła

In this paper, the problem of disambiguating a target word for Polish is approached by searching for related words with known meaning. These relatives are used to build a training corpus from unannotated text. This techn…

Word Sense Disambiguation

An Entity-centric Approach for Overcoming Knowledge Graph Sparsity

2015-09-01 · EMNLP 2015 9 · Manjunath Hegde, Partha P. Talukdar
Knowledge Graphs

PunFields at SemEval-2017 Task 7: Employing Roget's Thesaurus in Automatic Pun Recognition and Interpretation

2017-07-18 · SEMEVAL 2017 8 · Elena Mikhalkova, Yuri Karyakin

The article describes a model of automatic interpretation of English puns, based on Roget's Thesaurus, and its implementation, PunFields. In a pun, the algorithm discovers two groups of words that belong to two main sema…

General Classification