Computational Fact-Checking of Online Discourse: Scoring scientific accuracy in climate change related news articles
Democratic societies need reliable information. Misinformation in popular media such as news articles or videos threatens to impair civic discourse. Citizens are, unfortunately, not equipped to verify this content flood consumed daily at increasing rates. This work aims to semi-automatically quantify scientific accuracy of online media. By semantifying media of unknown veracity, their statements can be compared against equally processed trusted sources. We implemented a workflow using LLM-based statement extraction and knowledge graph analysis. Our neurosymbolic system was able to evidently streamline state-of-the-art veracity quantification. Evaluated via expert interviews and a user survey, the tool provides a beneficial veracity indication. This indicator, however, is unable to annotate public media at the required granularity and scale. Further work towards a FAIR (Findable, Accessible, Interoperable, Reusable) ground truth and complementary metrics are required to scientifically support civic discourse.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesFact CheckingMisinformationSimilar Papers 제목 키워드 기반
Learning from Fact-checkers: Analysis and Generation of Fact-checking Language
In fighting against fake news, many fact-checking systems comprised of human-based fact-checking sites (e.g., snopes.com and politifact.com) and automatic detection systems have been developed in recent years. However, o…
Fact CheckingFake News DetectionMisinformationText GenerationRAVE: Retrieval and Scoring Aware Verifiable Claim Detection
The rapid spread of misinformation on social media underscores the need for scalable fact-checking tools. A key step is claim detection, which identifies statements that can be objectively verified. Prior approaches ofte…
Automatic Fact-Checking Using Context and Discourse Information
We study the problem of automatic fact-checking, paying special attention to the impact of contextual and discourse information. We address two related tasks: (i) detecting check-worthy claims, and (ii) fact-checking cla…
Fact CheckingLeveraging Social Discourse to Measure Check-worthiness of Claims for Fact-checking
The expansion of online social media platforms has led to a surge in online content consumption. However, this has also paved the way for disseminating false claims and misinformation. As a result, there is an escalating…
Fact CheckingMisinformationEvidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMs
Given the widespread dissemination of misinformation on social media, implementing fact-checking mechanisms for online claims is essential. Manually verifying every claim is very challenging, underscoring the need for an…
Fact CheckingIn-Context LearningLanguage ModelingLanguage Modelling+3