Diachronic word embeddings and semantic shifts: a survey
Recent years have witnessed a surge of publications aimed at tracing temporal changes in lexical semantics using distributional methods, particularly prediction-based word embedding models. However, this vein of research lacks the cohesion, common terminology and shared practices of more established areas of natural language processing. In this paper, we survey the current state of academic research related to diachronic word embeddings and semantic shifts detection. We start with discussing the notion of semantic shifts, and then continue with an overview of the existing methods for tracing such time-related shifts with word embedding models. We propose several axes along which these methods can be compared, and outline the main challenges before this emerging subfield of NLP, as well as prospects and possible applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Diachronic Word EmbeddingsSurveyWord EmbeddingsSimilar Papers 제목 키워드 기반
Analyzing Continuous Semantic Shifts with Diachronic Word Similarity Matrices
The meanings and relationships of words shift over time. This phenomenon is referred to as semantic shift. Research focused on understanding how semantic shifts occur over multiple time periods is essential for gaining a…
Word EmbeddingsWord SimilarityCharacterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings
Measuring how semantics of words change over time improves our understanding of how cultures and perspectives change. Diachronic word embeddings help us quantify this shift, although previous studies leveraged substantia…
ArticlesDiachronic Word EmbeddingsSentiment AnalysisWord EmbeddingsLeveraging Contextual Embeddings for Detecting Diachronic Semantic Shift
We propose a new method that leverages contextual embeddings for the task of diachronic semantic shift detection by generating time specific word representations from BERT embeddings. The results of our experiments in th…
Domain AdaptationSemantic Shift DetectionDUKweb: Diachronic word representations from the UK Web Archive corpus
Lexical semantic change (detecting shifts in the meaning and usage of words) is an important task for social and cultural studies as well as for Natural Language Processing applications. Diachronic word embeddings (time-…
Change DetectionDiachronic Word EmbeddingsWord EmbeddingsVisualisation Methods for Diachronic Semantic Shift
The meaning and usage of a concept or a word changes over time. These diachronic semantic shifts reflect the change of societal and cultural consensus as well as the evolution of science. The availability of large-scale …