paper-with-me

홈 › Papers

Harnessing Abstractive Summarization for Fact-Checked Claim Detection

2022-09-10 · COLING 2022 10 · Varad Bhatnagar, Diptesh Kanojia, Kameswari Chebrolu

Social media platforms have become new battlegrounds for anti-social elements, with misinformation being the weapon of choice. Fact-checking organizations try to debunk as many claims as possible while staying true to their journalistic processes but cannot cope with its rapid dissemination. We believe that the solution lies in partial automation of the fact-checking life cycle, saving human time for tasks which require high cognition. We propose a new workflow for efficiently detecting previously fact-checked claims that uses abstractive summarization to generate crisp queries. These queries can then be executed on a general-purpose retrieval system associated with a collection of previously fact-checked claims. We curate an abstractive text summarization dataset comprising noisy claims from Twitter and their gold summaries. It is shown that retrieval performance improves 2x by using popular out-of-the-box summarization models and 3x by fine-tuning them on the accompanying dataset compared to verbatim querying. Our approach achieves Recall@5 and MRR of 35% and 0.3, compared to baseline values of 10% and 0.1, respectively. Our dataset, code, and models are available publicly: https://github.com/varadhbhatnagar/FC-Claim-Det/

📄 PDF Abstract BibTeX arXiv:2209.04612

Code (1)

varadhbhatnagar/fc-claim-det 공식 구현

Tasks

Abstractive Text SummarizationFact CheckingMisinformationRetrievalText Summarization

Similar Papers 제목 키워드 기반

Benchmarking the Generation of Fact Checking Explanations

2023-08-29 · Daniel Russo, Serra Sinem Tekiroglu, Marco Guerini

Fighting misinformation is a challenging, yet crucial, task. Despite the growing number of experts being involved in manual fact-checking, this activity is time-consuming and cannot keep up with the ever-increasing amoun…

Abstractive Text SummarizationArticlesBenchmarkingFact Checking+2

Task Proposal: Abstractive Snippet Generation for Web Pages

2020-12-01 · INLG (ACL) 2020 12 · Shahbaz Syed, Wei-Fan Chen, Matthias Hagen, Benno Stein 외

We propose a shared task on abstractive snippet generation for web pages, a novel task of generating query-biased abstractive summaries for documents that are to be shown on a search results page. Conventional snippets a…

Abstractive Text Summarization

Evaluating the Tradeoff Between Abstractiveness and Factuality in Abstractive Summarization

2021-08-05 · Markus Dreyer, Mengwen Liu, Feng Nan, Sandeep Atluri 외

Neural models for abstractive summarization tend to generate output that is fluent and well-formed but lacks semantic faithfulness, or factuality, with respect to the input documents. In this paper, we analyze the tradeo…

Abstractive Text Summarization

Claim Extraction for Fact-Checking: Data, Models, and Automated Metrics

2025-02-07 · Herbert Ullrich, Tomáš Mlynář, Jan Drchal

In this paper, we explore the problem of Claim Extraction using one-to-many text generation methods, comparing LLMs, small summarization models finetuned for the task, and a previous NER-centric baseline QACG. As the cur…

4kFact CheckingNERText Generation

MultiClaimNet: A Massively Multilingual Dataset of Fact-Checked Claim Clusters

2025-03-28 · Rrubaa Panchendrarajan, Rubén Míguez, Arkaitz Zubiaga

In the context of fact-checking, claims are often repeated across various platforms and in different languages, which can benefit from a process that reduces this redundancy. While retrieving previously fact-checked clai…

ClusteringFact CheckingRetrievalSentence+2