paper-with-me

Papers

MultiVerS: Improving scientific claim verification with weak supervision and full-document context

2021-12-02 · Findings (NAACL) 2022 7 · David Wadden, Kyle Lo, Lucy Lu Wang, Arman Cohan, Iz Beltagy, Hannaneh Hajishirzi

The scientific claim verification task requires an NLP system to label scientific documents which Support or Refute an input claim, and to select evidentiary sentences (or rationales) justifying each predicted label. In this work, we present MultiVerS, which predicts a fact-checking label and identifies rationales in a multitask fashion based on a shared encoding of the claim and full document context. This approach accomplishes two key modeling goals. First, it ensures that all relevant contextual information is incorporated into each labeling decision. Second, it enables the model to learn from instances annotated with a document-level fact-checking label, but lacking sentence-level rationales. This allows MultiVerS to perform weakly-supervised domain adaptation by training on scientific documents labeled using high-precision heuristics. Our approach outperforms two competitive baselines on three scientific claim verification datasets, with particularly strong performance in zero / few-shot domain adaptation experiments. Our code and data are available at https://github.com/dwadden/multivers.

📄 PDF Abstract BibTeX arXiv:2112.01640

Code (3)

dwadden/longchecker 공식 구현 pytorch
dwadden/multivers 공식 구현 pytorch
bunsenfeng/factkb pytorch

Tasks

Claim VerificationDomain AdaptationFact CheckingSentence

Similar Papers 제목 키워드 기반

Modeling the Machine Learning Multiverse

2022-06-13 · Samuel J. Bell, Onno P. Kampman, Jesse Dodge, Neil D. Lawrence

Amid mounting concern about the reliability and credibility of machine learning research, we present a principled framework for making robust and generalizable claims: the multiverse analysis. Our framework builds upon t…

BIG-bench Machine LearningExperimental Design

LongChecker: Improving scientific claim verification by modeling full-abstract context

2022-01-16 · ACL ARR January 2022 1 · Anonymous

The spread of scientific mis- and dis-information has motivated the development of datasets and models for the task of scientific claim verification. We address two modeling challenges associated with this task. First, e…

Claim VerificationDomain AdaptationFact CheckingSentence

DecomposeRL: Learning to Ask Useful, Informative, and Diverse Questions for Semi-Supervised, Traceable Claim Verification

2026-05-27 · Shubhashis Roy Dipta, Ankur Padia, Francis Ferraro arxiv

Claim verification splits between end-to-end classifiers that are accurate but yields no inspectable traces, and decomposition-based methods produce inspectable traces but lag performance on benchmark datasets. We propos…

SciFact-Open: Towards open-domain scientific claim verification

2022-10-25 · David Wadden, Kyle Lo, Bailey Kuehl, Arman Cohan 외

While research on scientific claim verification has led to the development of powerful systems that appear to approach human performance, these approaches have yet to be tested in a realistic setting against large corpor…

Claim VerificationInformation RetrievalRetrieval

Format Matters: The Robustness of Multimodal LLMs in Reviewing Evidence from Tables and Charts

2025-11-13 · Xanh Ho, Yun-Ang Wu, Sunisth Kumar, Florian Boudin 외 arxiv

With the growing number of submitted scientific papers, there is an increasing demand for systems that can assist reviewers in evaluating research claims. Experimental results are a core component of scientific work, oft…

Multimodal Reasoning