Quantifying the dynamics of topical fluctuations in language
The availability of large diachronic corpora has provided the impetus for a growing body of quantitative research on language evolution and meaning change. The central quantities in this research are token frequencies of linguistic elements in texts, with changes in frequency taken to reflect the popularity or selective fitness of an element. However, corpus frequencies may change for a wide variety of reasons, including purely random sampling effects, or because corpora are composed of contemporary media and fiction texts within which the underlying topics ebb and flow with cultural and socio-political trends. In this work, we introduce a simple model for controlling for topical fluctuations in corpora - the topical-cultural advection model - and demonstrate how it provides a robust baseline of variability in word frequency changes over time. We validate the model on a diachronic corpus spanning two centuries, and a carefully-controlled artificial language change scenario, and then use it to correct for topical fluctuations in historical time series. Finally, we use the model to show that the emergence of new words typically corresponds with the rise of a trending topic. This suggests that some lexical innovations occur due to growing communicative need in a subspace of the lexicon, and that the topical-cultural advection model can be used to quantify this.
Code (1)
Tasks
Time SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
The Impact of Node Addition and Deletion on Network Production Fluctuations
Production networks, dynamic systems of firms linked through input-output relationships, transmit microeconomic shocks into macroeconomic fluctuations. While prior studies often assume static networks, real-world economi…
Quantifying the role of discourse topicality in speakers' choices of referring expressions
TED: Accelerate Model Training by Internal Generalization
Large language models have demonstrated strong performance in recent years, but the high cost of training drives the need for efficient methods to compress dataset sizes. We propose TED pruning, a method that addresses t…
image-classificationImage ClassificationLanguage ModelingLanguage Modelling+3Brave New World: Uncovering Topical Dynamics in the ACL Anthology Reference Corpus Using Term Life Cycle Information
Scale free density and correlations fluctuations in the dynamics of large microbial ecosystems
Microorganisms self-organize in very large communities exhibiting complex fluctuations. Despite recent advances, still the mechanism by which these systems are able to exhibit large variability at the one hand and dynami…