paper-with-me

홈 › Papers

Check-worthy Claim Detection across Topics for Automated Fact-checking

2022-12-16 · Amani S. Abumansour, Arkaitz Zubiaga

An important component of an automated fact-checking system is the claim check-worthiness detection system, which ranks sentences by prioritising them based on their need to be checked. Despite a body of research tackling the task, previous research has overlooked the challenging nature of identifying check-worthy claims across different topics. In this paper, we assess and quantify the challenge of detecting check-worthy claims for new, unseen topics. After highlighting the problem, we propose the AraCWA model to mitigate the performance deterioration when detecting check-worthy claims across topics. The AraCWA model enables boosting the performance for new topics by incorporating two components for few-shot learning and data augmentation. Using a publicly available dataset of Arabic tweets consisting of 14 different topics, we demonstrate that our proposed data augmentation strategy achieves substantial improvements across topics overall, where the extent of the improvement varies across topics. Further, we analyse the semantic similarities between topics, suggesting that the similarity metric could be used as a proxy to determine the difficulty level of an unseen topic prior to undertaking the task of labelling the underlying sentences.

📄 PDF Abstract BibTeX arXiv:2212.08514

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationFact CheckingFew-Shot Learning

Similar Papers 제목 키워드 기반

Supporting Automated Fact-checking across Topics: Similarity-driven Gradual Topic Learning for Claim Detection

2024-11-08 · Amani S. Abumansour, Arkaitz Zubiaga

Selecting check-worthy claims for fact-checking is considered a crucial part of expediting the fact-checking process by filtering out and ranking the check-worthy claims for being validated among the impressive amount of…

Domain AdaptationFact Checking

TrClaim-19: The First Collection for Turkish Check-Worthy Claim Detection with Annotator Rationales

2020-11-01 · CONLL 2020 · Yavuz Selim Kartal, Mucahid Kutlu

Massive misinformation spread over Internet has many negative impacts on our lives. While spreading a claim is easy, investigating its veracity is hard and time consuming, Therefore, we urgently need systems to help huma…

Misinformation

ViClaim: A Multilingual Multilabel Dataset for Automatic Claim Detection in Videos

2025-04-17 · Patrick Giedemann, Pius von Däniken, Jan Deriu, Alvaro Rodrigo 외

The growing influence of video content as a medium for communication and misinformation underscores the urgent need for effective tools to analyze claims in multilingual and multi-topic settings. Existing efforts in misi…

MisinformationSentence

MythQA: Query-Based Large-Scale Check-Worthy Claim Detection through Multi-Answer Open-Domain Question Answering

2023-07-21 · Yang Bai, Anthony Colas, Daisy Zhe Wang

Check-worthy claim detection aims at providing plausible misinformation to downstream fact-checking systems or human experts to check. This is a crucial step toward accelerating the fact-checking process. Many efforts ha…

Fact CheckingMisinformationOpen-Domain Question AnsweringQuestion Answering

MultiCW: A Large-Scale Balanced Benchmark Dataset for Training Robust Check-Worthiness Detection Models

2026-02-18 · Martin Hyben, Sebastian Kula, Jan Cegin, Jakub Simko 외 arxiv

Large Language Models (LLMs) are beginning to reshape how media professionals verify information, yet automated support for detecting check-worthy claims a key step in the fact-checking process remains limited. We introd…