Enhancing Health Fact-Checking with LLM-Generated Synthetic Data
Fact-checking for health-related content is challenging due to the limited availability of annotated training data. In this study, we propose a synthetic data generation pipeline that leverages large language models (LLMs) to augment training data for health-related fact checking. In this pipeline, we summarize source documents, decompose the summaries into atomic facts, and use an LLM to construct sentence-fact entailment tables. From the entailment relations in the table, we further generate synthetic text-claim pairs with binary veracity labels. These synthetic data are then combined with the original data to fine-tune a BERT-based fact-checking model. Evaluation on two public datasets, PubHealth and SciFact, shows that our pipeline improved F1 scores by up to 0.019 and 0.049, respectively, compared to models trained only on the original data. These results highlight the effectiveness of LLM-driven synthetic data augmentation in enhancing the performance of health-related fact-checkers.
Code (0)
등록된 구현이 없습니다.
Tasks
Synthetic Data GenerationData AugmentationFact CheckingSimilar Papers 제목 키워드 기반
Evidence-based Fact-Checking of Health-related Claims
The task of verifying the truthfulness of claims in textual documents, or fact-checking, has received significant attention in recent years. Many existing evidence-based factchecking datasets contain synthetic claims and…
ArticlesFact CheckingTrumorGPT: Graph-Based Retrieval-Augmented Large Language Model for Fact-Checking
In the age of social media, the rapid spread of misinformation and rumors has led to the emergence of infodemics, where false information poses a significant threat to society. To combat this issue, we introduce TrumorGP…
Fact CheckingFew-Shot Learninggraph constructionHallucination+7Take It Easy: Label-Adaptive Self-Rationalization for Fact Verification and Explanation Generation
Computational methods to aid journalists in the task often require adapting a model to specific domains and generating explanations. However, most automated fact-checking methods rely on three-class datasets, which do no…
Explanation GenerationFact CheckingFact VerificationMisinformation+2Mitigating hallucinations in healthcare LLMs with granular fact-checking and domain-specific adaptation
In healthcare, it is essential for any Large Language Model (LLM)-generated output to be reliable and accurate, particularly in cases involving decision-making and patient safety. However, the outputs are often unreliabl…
Communication Styles and Reader Preferences of LLM and Human Experts in Explaining Health Information
With the wide adoption of large language models (LLMs) in information assistance, it is essential to examine their alignment with human communication styles and values. We situate this study within the context of fact-ch…
ArticlesFact CheckingMisinformationPersuasiveness