paper-with-me

Papers

Autonomation, not Automation: Activities and Needs of Fact-checkers as a Basis for Designing Human-Centered AI Systems

2022-11-22 · Andrea Hrckova, Robert Moro, Ivan Srba, Jakub Simko, Maria Bielikova

To mitigate the negative effects of false information more effectively, the development of Artificial Intelligence (AI) systems assisting fact-checkers is needed. Nevertheless, the lack of focus on the needs of these stakeholders results in their limited acceptance and skepticism toward automating the whole fact-checking process. In this study, we conducted semi-structured in-depth interviews with Central European fact-checkers. Their activities and problems were analyzed using iterative content analysis. The most significant problems were validated with a survey of European fact-checkers, in which we collected 24 responses from 20 countries, i.e., 62\% of active European signatories of the International Fact-Checking Network (IFCN). Our contributions include an in-depth examination of the variability of fact-checking work in non-English speaking regions, which still remained largely uncovered. By aligning them with the knowledge from prior studies, we created conceptual models that help understand the fact-checking processes. Thanks to the interdisciplinary collaboration, we extend the fact-checking process in AI research by three additional stages. In addition, we mapped our findings on the fact-checkers' activities and needs to the relevant tasks for AI research. The new opportunities identified for AI researchers and developers have implications for the focus of AI research in this domain.

📄 PDF Abstract BibTeX arXiv:2211.12143

Code (0)

등록된 구현이 없습니다.

Tasks

Fact Checking

Similar Papers 제목 키워드 기반

Exploring Multidimensional Checkworthiness: Designing AI-assisted Claim Prioritization for Human Fact-checkers

2024-12-11 · Houjiang Liu, Jacek Gwizdka, Matthew Lease

Given the massive volume of potentially false claims circulating online, claim prioritization is essential in allocating limited human resources available for fact-checking. In this study, we perceive claim prioritizatio…

Fact CheckingInformation Retrieval

Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking

2025-02-13 · Greta Warren, Irina Shklovski, Isabelle Augenstein

The pervasiveness of large language models and generative AI in online media has amplified the need for effective automated fact-checking to assist fact-checkers in tackling the increasing volume and sophistication of mi…

Decision MakingFact CheckingMisinformation

Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI

2023-08-14 · Houjiang Liu, Anubrata Das, Alexander Boltz, Didi Zhou 외

While many Natural Language Processing (NLP) techniques have been proposed for fact-checking, both academic research and fact-checking organizations report limited adoption of such NLP work due to poor alignment with fac…

Fact CheckingMisinformation

Learning from Fact-checkers: Analysis and Generation of Fact-checking Language

2019-10-05 · Nguyen Vo, Kyumin Lee

In fighting against fake news, many fact-checking systems comprised of human-based fact-checking sites (e.g., snopes.com and politifact.com) and automatic detection systems have been developed in recent years. However, o…

Fact CheckingFake News DetectionMisinformationText Generation

Multilingual Previously Fact-Checked Claim Retrieval

2023-05-13 · Matúš Pikuliak, Ivan Srba, Robert Moro, Timo Hromadka 외

Fact-checkers are often hampered by the sheer amount of online content that needs to be fact-checked. NLP can help them by retrieving already existing fact-checks relevant to the content being investigated. This paper in…

Retrieval