Explainable Automated Fact-Checking for Public Health Claims
Fact-checking is the task of verifying the veracity of claims by assessing their assertions against credible evidence. The vast majority of fact-checking studies focus exclusively on political claims. Very little research explores fact-checking for other topics, specifically subject matters for which expertise is required. We present the first study of explainable fact-checking for claims which require specific expertise. For our case study we choose the setting of public health. To support this case study we construct a new dataset PUBHEALTH of 11.8K claims accompanied by journalist crafted, gold standard explanations (i.e., judgments) to support the fact-check labels for claims. We explore two tasks: veracity prediction and explanation generation. We also define and evaluate, with humans and computationally, three coherence properties of explanation quality. Our results indicate that, by training on in-domain data, gains can be made in explainable, automated fact-checking for claims which require specific expertise.
Code (2)
Tasks
Explanation GenerationFact CheckingSimilar Papers 제목 키워드 기반
Tell Me Why: Explainable Public Health Fact-Checking with Large Language Models
This paper presents a comprehensive analysis of explainable fact-checking through a series of experiments, focusing on the ability of large language models to verify public health claims and provide explanations or justi…
Explanation GenerationFact Checkingparameter-efficient fine-tuningReinforcement Learning-based Knowledge Graph Reasoning for Explainable Fact-checking
Fact-checking is a crucial task as it ensures the prevention of misinformation. However, manual fact-checking cannot keep up with the rate at which false information is generated and disseminated online. Automated fact-c…
Fact CheckingMisinformationreinforcement-learningReinforcement Learning+1Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking
The pervasiveness of large language models and generative AI in online media has amplified the need for effective automated fact-checking to assist fact-checkers in tackling the increasing volume and sophistication of mi…
Decision MakingFact CheckingMisinformationExplainable Fact-checking through Question Answering
Misleading or false information has been creating chaos in some places around the world. To mitigate this issue, many researchers have proposed automated fact-checking methods to fight the spread of fake news. However, m…
Decision MakingFact CheckingQuestion AnsweringAutomated Claim Matching with Large Language Models: Empowering Fact-Checkers in the Fight Against Misinformation
In today's digital era, the rapid spread of misinformation poses threats to public well-being and societal trust. As online misinformation proliferates, manual verification by fact checkers becomes increasingly challengi…
Fact CheckingMisinformation