Self-Supervised Claim Identification for Automated Fact Checking
We propose a novel, attention-based self-supervised approach to identify "claim-worthy" sentences in a fake news article, an important first step in automated fact-checking. We leverage "aboutness" of headline and content using attention mechanism for this task. The identified claims can be used for downstream task of claim verification for which we are releasing a benchmark dataset of manually selected compelling articles with veracity labels and associated evidence. This work goes beyond stylistic analysis to identifying content that influences reader belief. Experiments with three datasets show the strength of our model. Data and code available at https://github.com/architapathak/Self-Supervised-ClaimIdentification
Code (1)
Tasks
ArticlesClaim VerificationFact CheckingSimilar Papers 제목 키워드 기반
How We Refute Claims: Automatic Fact-Checking through Flaw Identification and Explanation
Automated fact-checking is a crucial task in the governance of internet content. Although various studies utilize advanced models to tackle this issue, a significant gap persists in addressing complex real-world rumors a…
Fact CheckingAssessing Effectiveness of Using Internal Signals for Check-Worthy Claim Identification in Unlabeled Data for Automated Fact-Checking
While recent work on automated fact-checking has focused mainly on verifying and explaining claims, for which the list of claims is readily available, identifying check-worthy claim sentences from a text remains challeng…
ArticlesFact CheckingRetrievalSemantic Similarity+2FactLens: Benchmarking Fine-Grained Fact Verification
Large Language Models (LLMs) have shown impressive capability in language generation and understanding, but their tendency to hallucinate and produce factually incorrect information remains a key limitation. To verify LL…
BenchmarkingFact VerificationText GenerationWatClaimCheck: A new Dataset for Claim Entailment and Inference
We contribute a new dataset for the task of automated fact checking and an evaluation of state of the art algorithms. The dataset includes claims (from speeches, interviews, social media and news articles), review articl…
ArticlesFact CheckingPassage RetrievalRetrievalGenerating Scientific Claims for Zero-Shot Scientific Fact Checking
Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we prop…
Fact CheckingNegation