Covid-Transformer: Detecting COVID-19 Trending Topics on Twitter Using Universal Sentence Encoder
The novel corona-virus disease (also known as COVID-19) has led to a pandemic, impacting more than 200 countries across the globe. With its global impact, COVID-19 has become a major concern of people almost everywhere, and therefore there are a large number of tweets coming out from every corner of the world, about COVID-19 related topics. In this work, we try to analyze the tweets and detect the trending topics and major concerns of people on Twitter, which can enable us to better understand the situation, and devise better planning. More specifically we propose a model based on the universal sentence encoder to detect the main topics of Tweets in recent months. We used universal sentence encoder in order to derive the semantic representation and the similarity of tweets. We then used the sentence similarity and their embeddings, and feed them to K-means clustering algorithm to group similar tweets (in semantic sense). After that, the cluster summary is obtained using a text summarization algorithm based on deep learning, which can uncover the underlying topics of each cluster. Through experimental results, we show that our model can detect very informative topics, by processing a large number of tweets on sentence level (which can preserve the overall meaning of the tweets). Since this framework has no restriction on specific data distribution, it can be used to detect trending topics from any other social media and any other context rather than COVID-19. Experimental results show superiority of our proposed approach to other baselines, including TF-IDF, and latent Dirichlet allocation (LDA).
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringSentenceSentence SimilarityText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Assessing COVID-19 Impacts on College Students via Automated Processing of Free-form Text
In this paper, we report experimental results on assessing the impact of COVID-19 on college students by processing free-form texts generated by them. By free-form texts, we mean textual entries posted by college student…
FormDetecting COVID-19 Conspiracy Theories with Transformers and TF-IDF
The sharing of fake news and conspiracy theories on social media has wide-spread negative effects. By designing and applying different machine learning models, researchers have made progress in detecting fake news from t…
Common Sense ReasoningFake News DetectionArCovidVac: Analyzing Arabic Tweets About COVID-19 Vaccination
The emergence of the COVID-19 pandemic and the first global infodemic have changed our lives in many different ways. We relied on social media to get the latest information about the COVID-19 pandemic and at the same tim…
InformativenessStance DetectionDeep-COVID: Predicting COVID-19 From Chest X-Ray Images Using Deep Transfer Learning
The novel corona-virus (also known as Covid-19) has led to a pandemic, impacting more than 200 countries across the globe. With this huge scale, there are a very large number of tweets coming out from every corner of the…
SentenceTransfer LearningdzStance at StanceEval2024: Arabic Stance Detection based on Sentence Transformers
This study compares Term Frequency-Inverse Document Frequency (TF-IDF) features with Sentence Transformers for detecting writers' stances--favorable, opposing, or neutral--towards three significant topics: COVID-19 vacci…
PositionSentenceStance Detection