paper-with-me

홈 › Papers

Analyzing COVID-19 Tweets with Transformer-based Language Models

2021-04-20 · Philip Feldman, Sim Tiwari, Charissa S. L. Cheah, James R. Foulds, SHimei Pan

This paper describes a method for using Transformer-based Language Models (TLMs) to understand public opinion from social media posts. In this approach, we train a set of GPT models on several COVID-19 tweet corpora that reflect populations of users with distinctive views. We then use prompt-based queries to probe these models to reveal insights into the biases and opinions of the users. We demonstrate how this approach can be used to produce results which resemble polling the public on diverse social, political and public health issues. The results on the COVID-19 tweet data show that transformer language models are promising tools that can help us understand public opinions on social media at scale.

📄 PDF Abstract BibTeX arXiv:2104.10259

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

ArCorona: Analyzing Arabic Tweets in the Early Days of Coronavirus (COVID-19) Pandemic

2020-12-02 · EACL (Louhi) 2021 4 · Hamdy Mubarak, Sabit Hassan

Over the past few months, there were huge numbers of circulating tweets and discussions about Coronavirus (COVID-19) in the Arab region. It is important for policy makers and many people to identify types of shared tweet…

Misinformation

SenWave: A Fine-Grained Multi-Language Sentiment Analysis Dataset Sourced from COVID-19 Tweets

2025-10-09 · Qiang Yang, Xiuying Chen, Changsheng Ma, Rui Yin 외 arxiv

The global impact of the COVID-19 pandemic has highlighted the need for a comprehensive understanding of public sentiment and reactions. Despite the availability of numerous public datasets on COVID-19, some reaching vol…

Sentiment Analysis

Deep-COVID: Predicting COVID-19 From Chest X-Ray Images Using Deep Transfer Learning

2020-04-20 · Shervin Minaee, Rahele Kafieh, Milan Sonka, Shakib Yazdani 외

The novel corona-virus (also known as Covid-19) has led to a pandemic, impacting more than 200 countries across the globe. With this huge scale, there are a very large number of tweets coming out from every corner of the…

SentenceTransfer Learning

COVID-19 Tweets Analysis through Transformer Language Models

2021-02-27 · Abdul Hameed Azeemi, Adeel Waheed

Understanding the public sentiment and perception in a healthcare crisis is essential for developing appropriate crisis management techniques. While some studies have used Twitter data for predictive modelling during COV…

ManagementMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSentiment Analysis

Leveraging Large Language Models and Weak Supervision for Social Media data annotation: an evaluation using COVID-19 self-reported vaccination tweets

2023-09-12 · Ramya Tekumalla, Juan M. Banda

The COVID-19 pandemic has presented significant challenges to the healthcare industry and society as a whole. With the rapid development of COVID-19 vaccines, social media platforms have become a popular medium for discu…