Dynamic Social Media Monitoring for Fast-Evolving Online Discussions
Tracking and collecting fast-evolving online discussions provides vast data for studying social media usage and its role in people's public lives. However, collecting social media data using a static set of keywords fails to satisfy the growing need to monitor dynamic conversations and to study fast-changing topics. We propose a dynamic keyword search method to maximize the coverage of relevant information in fast-evolving online discussions. The method uses word embedding models to represent the semantic relations between keywords and predictive models to forecast the future time series. We also implement a visual user interface to aid in the decision-making process in each round of keyword updates. This allows for both human-assisted tracking and fully-automated data collection. In simulations using historical #MeToo data in 2017, our human-assisted tracking method outperforms the traditional static baseline method significantly, with 37.1% higher F-1 score than traditional static monitors in tracking the top trending keywords. We conduct a contemporary case study to cover dynamic conversations about the recent Presidential Inauguration and to test the dynamic data collection system. Our case studies reflect the effectiveness of our process and also points to the potential challenges in future deployment.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
A Domain-Agnostic Neurosymbolic Approach for Big Social Data Analysis: Evaluating Mental Health Sentiment on Social Media during COVID-19
Monitoring public sentiment via social media is potentially helpful during health crises such as the COVID-19 pandemic. However, traditional frequency-based, data-driven neural network-based approaches can miss newly rel…
ArticlesKnowledge GraphsFinding Social Media Trolls: Dynamic Keyword Selection Methods for Rapidly-Evolving Online Debates
Online harassment is a significant social problem. Prevention of online harassment requires rapid detection of harassing, offensive, and negative social media posts. In this paper, we propose the use of word embedding mo…
Data Innovation for International Development: An overview of natural language processing for qualitative data analysis
Availability, collection and access to quantitative data, as well as its limitations, often make qualitative data the resource upon which development programs heavily rely. Both traditional interview data and social medi…
Decision MakingTime Will Change Things: An Empirical Study on Dynamic Language Understanding in Social Media Classification
Language features are ever-evolving in the real-world social media environment. Many trained models in natural language understanding (NLU), ineffective in semantic inference for unseen features, might consequently strug…
Domain AdaptationNatural Language UnderstandingVoTranhOmniLearner - A Self-Evolving Digital Universe for Simulating Consciousness and Societal Dynamics
VoTranhOmniLearner is an innovative simulation framework designed to model a dynamic digital universe with thousands of entities, intricate social interactions, and self-reflective processes. By integrating machine learn…
Management