A Revisit of Fake News Dataset with Augmented Fact-checking by ChatGPT
The proliferation of fake news has emerged as a critical issue in recent years, requiring significant efforts to detect it. However, the existing fake news detection datasets are sourced from human journalists, which are likely to have inherent bias limitations due to the highly subjective nature of this task. In this paper, we revisit the existing fake news dataset verified by human journalists with augmented fact-checking by large language models (ChatGPT), and we name the augmented fake news dataset ChatGPT-FC. We quantitatively analyze the distinctions and resemblances between human journalists and LLM in assessing news subject credibility, news creator credibility, time-sensitive, and political framing. Our findings highlight LLM's potential to serve as a preliminary screening method, offering a promising avenue to mitigate the inherent biases of human journalists and enhance fake news detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Fact CheckingFake News DetectionSimilar Papers 제목 키워드 기반
VeraCT Scan: Retrieval-Augmented Fake News Detection with Justifiable Reasoning
The proliferation of fake news poses a significant threat not only by disseminating misleading information but also by undermining the very foundations of democracy. The recent advance of generative artificial intelligen…
Fake News DetectionRetrievalAutomated Evidence Collection for Fake News Detection
Fake news, misinformation, and unverifiable facts on social media platforms propagate disharmony and affect society, especially when dealing with an epidemic like COVID-19. The task of Fake News Detection aims to tackle …
ArticlesFake News DetectionMisinformationRADAR: Retrieval-Augmented Detector with Adversarial Refinement for Robust Fake News Detection
To efficiently combat the spread of LLM-generated misinformation, we present RADAR, a Retrieval-Augmented Detector with Adversarial Refinement for robust fake news detection. Our approach employs a generator that rewrite…
Fake News DetectionPassage RetrievalDataset of Fake News Detection and Fact Verification: A Survey
The rapid increase in fake news, which causes significant damage to society, triggers many fake news related studies, including the development of fake news detection and fact verification techniques. The resources for t…
Fact VerificationFake News DetectionSatire DetectionSurveyConnecting the Dots Between Fact Verification and Fake News Detection
Fact verification models have enjoyed a fast advancement in the last two years with the development of pre-trained language models like BERT and the release of large scale datasets such as FEVER. However, the challenging…
Fact VerificationFake News DetectionText Summarization