paper-with-me

홈 › Papers

Interactive Learning for Identifying Relevant Tweets to Support Real-time Situational Awareness

2019-08-01 · Luke S. Snyder, Yi-Shan Lin, Morteza Karimzadeh, Dan Goldwasser, David S. Ebert

Various domain users are increasingly leveraging real-time social media data to gain rapid situational awareness. However, due to the high noise in the deluge of data, effectively determining semantically relevant information can be difficult, further complicated by the changing definition of relevancy by each end user for different events. The majority of existing methods for short text relevance classification fail to incorporate users' knowledge into the classification process. Existing methods that incorporate interactive user feedback focus on historical datasets. Therefore, classifiers cannot be interactively retrained for specific events or user-dependent needs in real-time. This limits real-time situational awareness, as streaming data that is incorrectly classified cannot be corrected immediately, permitting the possibility for important incoming data to be incorrectly classified as well. We present a novel interactive learning framework to improve the classification process in which the user iteratively corrects the relevancy of tweets in real-time to train the classification model on-the-fly for immediate predictive improvements. We computationally evaluate our classification model adapted to learn at interactive rates. Our results show that our approach outperforms state-of-the-art machine learning models. In addition, we integrate our framework with the extended Social Media Analytics and Reporting Toolkit (SMART) 2.0 system, allowing the use of our interactive learning framework within a visual analytics system tailored for real-time situational awareness. To demonstrate our framework's effectiveness, we provide domain expert feedback from first responders who used the extended SMART 2.0 system.

📄 PDF Abstract BibTeX arXiv:1908.02588

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral Classification

Similar Papers 제목 키워드 기반

Emotion Analysis on Twitter: The Hidden Challenge

2016-05-01 · LREC 2016 5 · Luca Dini, Andr{\'e} Bittar

In this paper, we present an experiment to detect emotions in tweets. Unlike much previous research, we draw the important distinction between the tasks of emotion detection in a closed world assumption (i.e. every tweet…

BIG-bench Machine LearningEmotion Recognition

On Identifying Disaster-Related Tweets: Matching-based or Learning-based?

2017-05-04 · Hien To, Sumeet Agrawal, Seon Ho Kim, Cyrus Shahabi

Social media such as tweets are emerging as platforms contributing to situational awareness during disasters. Information shared on Twitter by both affected population (e.g., requesting assistance, warning) and those out…

Sentiment Analysis

EveTAR: Building a Large-Scale Multi-Task Test Collection over Arabic Tweets

2017-08-21 · Hasanain Maram, Suwaileh Reem, Elsayed Tamer, Kutlu Mucahid 외

This article introduces a new language-independent approach for creating a large-scale high-quality test collection of tweets that supports multiple information retrieval (IR) tasks without running a shared-task campaign…

Event DetectionInformation RetrievalRetrieval

Crowdsourcing Salient Information from News and Tweets

2016-05-01 · LREC 2016 5 · Oana Inel, Tommaso Caselli, Lora Aroyo

The increasing streams of information pose challenges to both humans and machines. On the one hand, humans need to identify relevant information and consume only the information that lies at their interests. On the other…

Articles

Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments

2022-12-19 · Ethan Mendes, Yang Chen, Wei Xu, Alan Ritter

We present a human-in-the-loop evaluation framework for fact-checking novel misinformation claims and identifying social media messages that support them. Our approach extracts check-worthy claims, which are aggregated a…

Fact CheckingMisinformation