Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detection
Misinformation surrounding emerging outbreaks poses a serious societal threat, making robust countermeasures essential. One promising approach is stance detection (SD), which identifies whether social media posts support or oppose misleading claims. In this work, we finetune classifiers on COVID-19 misinformation SD datasets consisting of claims and corresponding tweets. Specifically, we test controllable misinformation generation (CMG) using large language models (LLMs) as a method for data augmentation. While CMG demonstrates the potential for expanding training datasets, our experiments reveal that performance gains over traditional augmentation methods are often minimal and inconsistent, primarily due to built-in safeguards within LLMs. We release our code and datasets to facilitate further research on misinformation detection and generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationMisinformationStance DetectionSimilar Papers 제목 키워드 기반
COVID-19 Vaccine Misinformation in Middle Income Countries
This paper introduces a multilingual dataset of COVID-19 vaccine misinformation, consisting of annotated tweets from three middle-income countries: Brazil, Indonesia, and Nigeria. The expertly curated dataset includes an…
Language ModellingLarge Language ModelMisinformationSpecificity+1The COVMis-Stance dataset: Stance Detection on Twitter for COVID-19 Misinformation
During the COVID-19 pandemic, large amounts of COVID-19 misinformation are spreading on social media. We are interested in the stance of Twitter users towards COVID-19 misinformation. However, due to the relative recent …
MisinformationStance DetectionThe Role of the Crowd in Countering Misinformation: A Case Study of the COVID-19 Infodemic
Fact checking by professionals is viewed as a vital defense in the fight against misinformation.While fact checking is important and its impact has been significant, fact checks could have limited visibility and may not …
Fact CheckingMisinformationNot cool, calm or collected: Using emotional language to detect COVID-19 misinformation
COVID-19 misinformation on social media platforms such as twitter is a threat to effective pandemic management. Prior works on tweet COVID-19 misinformation negates the role of semantic features common to twitter such as…
ManagementMisinformationCOVID-19 and Misinformation: A Large-Scale Lexical Analysis on Twitter
Social media is often used by individuals and organisations as a platform to spread misinformation. With the recent coronavirus pandemic we have seen a surge of misinformation on Twitter, posing a danger to public health…
Lexical AnalysisMisinformation