Effects of Sampling on Twitter Trend Detection
Much research has focused on detecting trends on Twitter, including health-related trends such as mentions of Influenza-like illnesses or their symptoms. The majority of this research has been conducted using Twitter{'}s public feed, which includes only about 1{\%} of all public tweets. It is unclear if, when, and how using Twitter{'}s 1{\%} feed has affected the evaluation of trend detection methods. In this work we use a larger feed to investigate the effects of sampling on Twitter trend detection. We focus on using health-related trends to estimate the prevalence of Influenza-like illnesses based on tweets. We use ground truth obtained from the CDC and Google Flu Trends to explore how the prevalence estimates degrade when moving from a 100{\%} to a 1{\%} sample. We find that using the 1{\%} sample is unlikely to substantially harm ILI estimates made at the national level, but can cause poor performance when estimates are made at the city level.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Methods of Informational Trends Analytics and Fake News Detection on Twitter
In the paper, different approaches for the analysis of news trends on Twitter has been considered. For the analysis and case study, informational trends on Twitter caused by Russian invasion of Ukraine in 2022 year have …
Fake News DetectionHunting for Spammers: Detecting Evolved Spammers on Twitter
Once an email problem, spam has nowadays branched into new territories with disruptive effects. In particular, spam has established itself over the recent years as a ubiquitous, annoying, and sometimes threatening aspect…
Spam detectionOn-line Trend Analysis with Topic Models: \#twitter Trends Detection Topic Model Online
Variation across Scales: Measurement Fidelity under Twitter Data Sampling
A comprehensive understanding of data quality is the cornerstone of measurement studies in social media research. This paper presents in-depth measurements on the effects of Twitter data sampling across different timesca…
RhythmWhat's up on Twitter? Catch up with TWIST!
Event detection and analysis with respect to public opinions and sentiments in social media is a broad and well-addressed research topic. However, the characteristics and sheer volume of noisy Twitter messages make this …
ClusteringEvent DetectionSentiment Analysis