Can Word Sense Distribution Detect Semantic Changes of Words?
Semantic Change Detection (SCD) of words is an important task for various NLP applications that must make time-sensitive predictions. Some words are used over time in novel ways to express new meanings, and these new meanings establish themselves as novel senses of existing words. On the other hand, Word Sense Disambiguation (WSD) methods associate ambiguous words with sense ids, depending on the context in which they occur. Given this relationship between WSD and SCD, we explore the possibility of predicting whether a target word has its meaning changed between two corpora collected at different time steps, by comparing the distributions of senses of that word in each corpora. For this purpose, we use pretrained static sense embeddings to automatically annotate each occurrence of the target word in a corpus with a sense id. Next, we compute the distribution of sense ids of a target word in a given corpus. Finally, we use different divergence or distance measures to quantify the semantic change of the target word across the two given corpora. Our experimental results on SemEval 2020 Task 1 dataset show that word sense distributions can be accurately used to predict semantic changes of words in English, German, Swedish and Latin.
Code (1)
Tasks
Change DetectionWord Sense DisambiguationSimilar Papers 제목 키워드 기반
A Methodology for Building a Diachronic Dataset of Semantic Shifts and its Application to QC-FR-Diac-V1.0, a Free Reference for French
Different algorithms have been proposed to detect semantic shifts (changes in a word meaning over time) in a diachronic corpus. Yet, and somehow surprisingly, no reference corpus has been designed so far to evaluate them…
Semantic Shift DetectionWord Sense DisambiguationDiaSense at SemEval-2020 Task 1: Modeling Sense Change via Pre-trained BERT Embeddings
This paper describes DiaSense, a system developed for Task 1 {`}Unsupervised Lexical Semantic Change Detection{'} of SemEval 2020. In DiaSense, contextualized word embeddings are used to model word sense changes. This al…
Change DetectionWord EmbeddingsGraph-based Clustering for Detecting Semantic Change Across Time and Languages
Despite the predominance of contextualized embeddings in NLP, approaches to detect semantic change relying on these embeddings and clustering methods underperform simpler counterparts based on static word embeddings. Thi…
Binary ClassificationClusteringWord EmbeddingsA Semantic Distance Metric Learning approach for Lexical Semantic Change Detection
Detecting temporal semantic changes of words is an important task for various NLP applications that must make time-sensitive predictions. Lexical Semantic Change Detection (SCD) task involves predicting whether a given t…
Change DetectionMetric LearningSentenceSemantic Change in the Language of UK Parliamentary Debates
We investigate changes in the meanings of words used in the UK Parliament across two different epochs. We use word embeddings to explore changes in the distribution of words of interest and uncover words that appear to h…
Word Embeddings