paper-with-me

Papers

Generating Scientific Claims for Zero-Shot Scientific Fact Checking

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we propose scientific claim generation, the task of generating one or more atomic and verifiable claims from scientific sentences, and demonstrate its usefulness in zero-shot fact checking for biomedical claims. We propose ClaimGen-BART, a new supervised method for generating claims supported by the literature, as well as KBIN, a novel method for generating claim negations. Additionally, we adapt an existing unsupervised entity-centric method of claim generation to biomedical claims, which we call ClaimGen-Entity. Experiments on zero-shot fact checking demonstrate that both ClaimGen-Entity and ClaimGen-BART, coupled with KBIN, achieve up to 90% performance of fully supervised models trained on manually annotated claims and evidence. A rigorous evaluation study demonstrates significant improvement in generated claim and negation quality over existing baselines

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Fact CheckingNegation

Similar Papers 제목 키워드 기반

Generating Scientific Claims for Zero-Shot Scientific Fact Checking

2022-03-24 · ACL 2022 5 · Dustin Wright, David Wadden, Kyle Lo, Bailey Kuehl 외

Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we prop…

Fact CheckingNegation

NSF-SciFy: Mining the NSF Awards Database for Scientific Claims

2025-03-11 · Delip Rao, Weiqiu You, Eric Wong, Chris Callison-Burch

We present NSF-SciFy, a large-scale dataset for scientific claim extraction derived from the National Science Foundation (NSF) awards database, comprising over 400K grant abstracts spanning five decades. While previous d…

16kAbstract generationClaim Verification

Can Large Language Models Detect Misinformation in Scientific News Reporting?

2024-02-22 · Yupeng Cao, Aishwarya Muralidharan Nair, Elyon Eyimife, Nastaran Jamalipour Soofi 외

Scientific facts are often spun in the popular press with the intent to influence public opinion and action, as was evidenced during the COVID-19 pandemic. Automatic detection of misinformation in the scientific domain i…

ArticlesClaim VerificationMisinformationPrompt Engineering

ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts

2025-06-10 · Ruiran Su, Jiasheng Si, Zhijiang Guo, Janet B. Pierrehumbert

Scientific fact-checking has mostly focused on text and tables, overlooking scientific charts, which are key for presenting quantitative evidence and statistical reasoning. We introduce ClimateViz, the first large-scale …

Fact CheckingFact Verification

DS@GT at CheckThat! 2025: Exploring Retrieval and Reranking Pipelines for Scientific Claim Source Retrieval on Social Media Discourse

2025-07-09 · Jeanette Schofield, Shuyu Tian, Hoang Thanh Thanh Truong, Maximilian Heil arxiv

Social media users often make scientific claims without citing where these claims come from, generating a need to verify these claims. This paper details work done by the DS@GT team for CLEF 2025 CheckThat! Lab Task 4b S…

Data Augmentation