Using neural topic models to track context shifts of words: a case study of COVID-related terms before and after the lockdown in April 2020
This paper explores lexical meaning changes in a new dataset, which includes tweets from before and after the COVID-related lockdown in April 2020. We use this dataset to evaluate traditional and more recent unsupervised approaches to lexical semantic change that make use of contextualized word representations based on the BERT neural language model to obtain representations of word usages. We argue that previous models that encode local representations of words cannot capture global context shifts such as the context shift of face masks since the pandemic outbreak. We experiment with neural topic models to track context shifts of words. We show that this approach can reveal textual associations of words that go beyond their lexical meaning representation. We discuss future work and how to proceed capturing the pragmatic aspect of meaning change as opposed to lexical semantic change.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingTopic ModelsSimilar Papers 제목 키워드 기반
Enhanced Short Text Modeling: Leveraging Large Language Models for Topic Refinement
Crafting effective topic models for brief texts, like tweets and news headlines, is essential for capturing the swift shifts in social dynamics. Traditional topic models, however, often fall short in accurately represent…
Prompt EngineeringTopic ModelsTopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detection
Real time nature of social networks with bursty short messages and their respective large data scale spread among vast variety of topics are research interest of many researchers. These properties of social networks whic…
Community DetectionGraph Miningnamed-entity-recognitionNamed Entity Recognition+2Identifying and Tracking Sentiments and Topics from Social Media Texts during Natural Disasters
We study the problem of identifying the topics and sentiments and tracking their shifts from social media texts in different geographical regions during emergencies and disasters. We propose a location-based dynamic sent…
Topic ModelsDTECT: Dynamic Topic Explorer & Context Tracker
The explosive growth of textual data over time presents a significant challenge in uncovering evolving themes and trends. Existing dynamic topic modeling techniques, while powerful, often exist in fragmented pipelines th…
Topic ModelsExploring the Technology Landscape through Topic Modeling, Expert Involvement, and Reinforcement Learning
In today's rapidly evolving technological landscape, organizations face the challenge of integrating external insights into their decision-making processes to stay competitive. To address this issue, this study proposes …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Topic Models