Deep Neural Models of Semantic Shift
Diachronic distributional models track changes in word use over time. In this paper, we propose a deep neural network diachronic distributional model. Instead of modeling lexical change via a time series as is done in previous work, we represent time as a continuous variable and model a word{'}s usage as a function of time. Additionally, we have also created a novel synthetic task which measures a model{'}s ability to capture the semantic trajectory. This evaluation quantitatively measures how well a model captures the semantic trajectory of a word over time. Finally, we explore how well the derivatives of our model can be used to measure the speed of lexical change.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Analyzing Continuous Semantic Shifts with Diachronic Word Similarity Matrices
The meanings and relationships of words shift over time. This phenomenon is referred to as semantic shift. Research focused on understanding how semantic shifts occur over multiple time periods is essential for gaining a…
Word EmbeddingsWord SimilarityRevisiting Statistical Laws of Semantic Shift in Romance Cognates
This article revisits statistical relationships across Romance cognates between lexical semantic shift and six intra-linguistic variables, such as frequency and polysemy. Cognates are words that are derived from a common…
Word EmbeddingsOne Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual Learning
In real-world continual learning (CL) scenarios, tasks often exhibit intricate and unpredictable semantic shifts, posing challenges for fixed prompt management strategies which are tailored to only handle semantic shifts…
AllContinual LearningManagementSemantic Similarity+1Visualisation Methods for Diachronic Semantic Shift
The meaning and usage of a concept or a word changes over time. These diachronic semantic shifts reflect the change of societal and cultural consensus as well as the evolution of science. The availability of large-scale …
An analysis of the semantic shifts of citations
The semantic shifts in natural language is a well established phenomenon and have been studied for many years. Similarly, the meanings of scientific publications may also change as time goes by. In other words, the same …