Real-time Event Detection on Social Data Streams
Social networks are quickly becoming the primary medium for discussing what is happening around real-world events. The information that is generated on social platforms like Twitter can produce rich data streams for immediate insights into ongoing matters and the conversations around them. To tackle the problem of event detection, we model events as a list of clusters of trending entities over time. We describe a real-time system for discovering events that is modular in design and novel in scale and speed: it applies clustering on a large stream with millions of entities per minute and produces a dynamically updated set of events. In order to assess clustering methodologies, we build an evaluation dataset derived from a snapshot of the full Twitter Firehose and propose novel metrics for measuring clustering quality. Through experiments and system profiling, we highlight key results from the offline and online pipelines. Finally, we visualize a high profile event on Twitter to show the importance of modeling the evolution of events, especially those detected from social data streams.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringEvent DetectionSimilar Papers 제목 키워드 기반
Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks
Events are happening in real-world and real-time, which can be planned and organized for occasions, such as social gatherings, festival celebrations, influential meetings or sports activities. Social media platforms gene…
ClusteringEvent DetectionA General Method for Event Detection on Social Media
Event detection on social media has attracted a number of researches, given the recent availability of large volumes of social media discussions. Previous works on social media event detection either assume a specific ty…
Event DetectionTime SeriesTime Series AnalysisWord EmbeddingsEventMapper: Detecting Real-World Physical Events Using Corroborative and Probabilistic Sources
The ubiquity of social media makes it a rich source for physical event detection, such as disasters, and as a potential resource for crisis management resource allocation. There have been some recent works on leveraging …
BIG-bench Machine LearningEvent DetectionManagementEvent Detection from Social Media Stream: Methods, Datasets and Opportunities
Social media streams contain large and diverse amount of information, ranging from daily-life stories to the latest global and local events and news. Twitter, especially, allows a fast spread of events happening real tim…
Event DetectionFine-grained Event Categorization with Heterogeneous Graph Convolutional Networks
Events are happening in real-world and real-time, which can be planned and organized occasions involving multiple people and objects. Social media platforms publish a lot of text messages containing public events with co…
ClusteringEvent Detection