Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models
Learning multi-task models for jointly detecting stance and verifying rumors poses challenges due to the need for training data of stance at post level and rumor veracity at claim level, which are difficult to obtain. To address this issue, we leverage large language models (LLMs) as the foundation annotators for the joint stance detection (SD) and rumor verification (RV) tasks, dubbed as JSDRV. We introduce a novel reinforcement tuning framework to enhance the joint predictive capabilities of LLM-based SD and RV components. Specifically, we devise a policy for selecting LLM-annotated data at the two levels, employing a hybrid reward mechanism to choose high-quality labels for effective LLM fine-tuning on both tasks. Results demonstrate that JSDRV improves the capabilities of LLMs in the joint tasks, not only outperforming state-of-the-art methods but also generalizing to non-LLMs accommodated as task models.
Code (0)
등록된 구현이 없습니다.
Tasks
Stance DetectionSimilar Papers 제목 키워드 기반
WSDMS: Debunk Fake News via Weakly Supervised Detection of Misinforming Sentences with Contextualized Social Wisdom
In recent years, we witness the explosion of false and unconfirmed information (i.e., rumors) that went viral on social media and shocked the public. Rumors can trigger versatile, mostly controversial stance expressions …
ArticlesMisinformationMultiple Instance LearningSentence+1The Future of Combating Rumors? Retrieval, Discrimination, and Generation
Artificial Intelligence Generated Content (AIGC) technology development has facilitated the creation of rumors with misinformation, impacting societal, economic, and political ecosystems, challenging democracy. Current r…
Language ModelingLanguage ModellingLarge Language ModelMisinformation+2Debunking Rumors on Twitter with Tree Transformer
Rumors are manufactured with no respect for accuracy, but can circulate quickly and widely by {``}word-of-post{''} through social media conversations. Conversation tree encodes important information indicative of the cre…
Debunking Rumors in Networks
We study the diffusion of a true and a false message (the rumor) in a social network. Upon hearing a message, individuals may believe it, disbelieve it, or debunk it through costly verification. Whenever the truth surviv…
Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detection
The proliferation of social media in communication and information dissemination has made it an ideal platform for spreading rumors. Automatically debunking rumors at their stage of diffusion is known as \textit{early ru…
Deep Attention