Exploring Word Usage Change with Continuously Evolving Embeddings
The usage of individual words can change over time, for example, when words experience a semantic shift. As text datasets generally comprise documents that were collected over a longer period of time, examining word usage changes in a corpus can often reveal interesting patterns. In this paper, we introduce a simple and intuitive way to track word usage changes via continuously evolving embeddings, computed as a weighted running average of transformer-based contextualized embeddings. We demonstrate our approach on a corpus of recent New York Times article snippets and provide code for an easy to use web app to conveniently explore semantic shifts with interactive plots.
Code (1)
Similar Papers 제목 키워드 기반
An Exploratory Study on Temporally Evolving Discussion around Covid-19 using Diachronic Word Embeddings
Covid 19 has seen the world go into a lock down and unconventional social situations throughout. During this time, the world saw a surge in information sharing around the pandemic and the topics shared in the time were d…
Diachronic Word EmbeddingsWord EmbeddingsQuantifying Lexical Semantic Shift via Unbalanced Optimal Transport
Lexical semantic change detection aims to identify shifts in word meanings over time. While existing methods using embeddings from a diachronic corpus pair estimate the degree of change for target words, they offer limit…
Change DetectionWord EmbeddingsEvolution of emotion semantics
Humans possess the unique ability to communicate emotions through language. Although concepts like anger or awe are abstract, there is a shared consensus about what these English emotion words mean. This consensus may gi…
Word EmbeddingsInterpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis
We propose using automatically generated natural language definitions of contextualised word usages as interpretable word and word sense representations. Given a collection of usage examples for a target word, and the co…
Language ModelingLanguage ModellingSemantic SimilaritySemantic Textual Similarity+2Tracking Semantic Shifts in German Court Decisions with Diachronic Word Embeddings
Language and its usage change over time. While legal language is arguably more stable than everyday language, it is still subject to change. Sometimes it changes gradually and slowly, sometimes almost instantaneously, fo…
Diachronic Word EmbeddingsWord Embeddings