paper-with-me

Papers

CluBERT: A Cluster-Based Approach for Learning Sense Distributions in Multiple Languages

2020-07-01 · ACL 2020 6 · Tommaso Pasini, Federico Scozzafava, Bianca Scarlini

Knowing the Most Frequent Sense (MFS) of a word has been proved to help Word Sense Disambiguation (WSD) models significantly. However, the scarcity of sense-annotated data makes it difficult to induce a reliable and high-coverage distribution of the meanings in a language vocabulary. To address this issue, in this paper we present CluBERT, an automatic and multilingual approach for inducing the distributions of word senses from a corpus of raw sentences. Our experiments show that CluBERT learns distributions over English senses that are of higher quality than those extracted by alternative approaches. When used to induce the MFS of a lemma, CluBERT attains state-of-the-art results on the English Word Sense Disambiguation tasks and helps to improve the disambiguation performance of two off-the-shelf WSD models. Moreover, our distributions also prove to be effective in other languages, beating all their alternatives for computing the MFS on the multilingual WSD tasks. We release our sense distributions in five different languages at https://github.com/SapienzaNLP/clubert.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

LEMMAWord Sense Disambiguation

Similar Papers 제목 키워드 기반

Graph-based Clustering for Detecting Semantic Change Across Time and Languages

2024-02-01 · Xianghe Ma, Michael Strube, Wei Zhao

Despite the predominance of contextualized embeddings in NLP, approaches to detect semantic change relying on these embeddings and clustering methods underperform simpler counterparts based on static word embeddings. Thi…

Binary ClassificationClusteringWord Embeddings

Enriching Word Usage Graphs with Cluster Definitions

2024-03-26 · Mariia Fedorova, Andrey Kutuzov, Nikolay Arefyev, Dominik Schlechtweg

We present a dataset of word usage graphs (WUGs), where the existing WUGs for multiple languages are enriched with cluster labels functioning as sense definitions. They are generated from scratch by fine-tuned encoder-de…

Decoder

Word Sense Induction with Attentive Context Clustering

2021-12-01 · NLP4DH (ICON) 2021 12 · Moshe Stekel, Amos Azaria, Shai Gordin

In this paper, we present ACCWSI (Attentive Context Clustering WSI), a method for Word Sense Induction, suitable for languages with limited resources. Pretrained on a small corpus and given an ambiguous word (query word)…

ClusteringWord Sense Induction

RUSSE'2018: A Shared Task on Word Sense Induction for the Russian Language

2018-03-15 · Alexander Panchenko, Anastasiya Lopukhina, Dmitry Ustalov, Konstantin Lopukhin 외

The paper describes the results of the first shared task on word sense induction (WSI) for the Russian language. While similar shared tasks were conducted in the past for some Romance and Germanic languages, we explore t…

Word Sense Induction

Hashtag Sense Clustering Based on Temporal Similarity

2017-04-01 · CL 2017 4 · Giovanni Stilo, Paola Velardi

Hashtags are creative labels used in micro-blogs to characterize the topic of a message/discussion. Regardless of the use for which they were originally intended, hashtags cannot be used as a means to cluster messages wi…

Clustering