FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs
Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking. FACT-GPT, trained on a synthetic dataset, identifies social media content that aligns with, contradicts, or is irrelevant to previously debunked claims. Our evaluation shows that our specialized LLMs can match the accuracy of larger models in identifying related claims, closely mirroring human judgment. This research provides an automated solution for efficient claim matching, demonstrates the potential of LLMs in supporting fact-checkers, and offers valuable resources for further research in the field.
Code (1)
Tasks
Fact CheckingMisinformationSimilar Papers 제목 키워드 기반
Automated Claim Matching with Large Language Models: Empowering Fact-Checkers in the Fight Against Misinformation
In today's digital era, the rapid spread of misinformation poses threats to public well-being and societal trust. As online misinformation proliferates, manual verification by fact checkers becomes increasingly challengi…
Fact CheckingMisinformationClaim Matching Beyond English to Scale Global Fact-Checking
Manual fact-checking does not scale well to serve the needs of the internet. This issue is further compounded in non-English contexts. In this paper, we discuss claim matching as a possible solution to scale fact-checkin…
Fact CheckingKnowledge DistillationZero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checking
The claim matching (CM) task can benefit an automated fact-checking pipeline by putting together claims that can be resolved with the same fact-check. In this work, we are the first to explore zero-shot and few-shot lear…
Binary ClassificationFact CheckingFew-Shot LearningInstruction Following+1MultiClaimNet: A Massively Multilingual Dataset of Fact-Checked Claim Clusters
In the context of fact-checking, claims are often repeated across various platforms and in different languages, which can benefit from a process that reduces this redundancy. While retrieving previously fact-checked clai…
ClusteringFact CheckingRetrievalSentence+2QuestGen: Effectiveness of Question Generation Methods for Fact-Checking Applications
Verifying fact-checking claims poses a significant challenge, even for humans. Recent approaches have demonstrated that decomposing claims into relevant questions to gather evidence enhances the efficiency of the fact-ch…
Data AugmentationFact CheckingQuestion GenerationQuestion-Generation