paper-with-me

홈 › Papers

Can Scientific Claims Be Removed from Large Language Models? A Systematic Evaluation of Claim-Level Unlearning

2026-08-21 · Snigdha Paul, Manasi Patwardhan, Arman Cohan arxiv

Language models (LMs) are trained on static scientific corpora, whereas scientific knowledge continuously evolves through correction and revision. Scientific claims encoded within these models may later become retracted, disproven, or updated by subsequent research, creating the risk of disseminating outdated information in scientific workflows. This creates a need for LMs to forget obsolete scientific claims. Machine unlearning offers a promising solution by enabling knowledge removal while maintaining overall model utility. Existing studies primarily investigate instance-level forgetting; however, scientific claims introduce additional challenges because they are interconnected, and continually evolving. To address this gap, we introduce the task of Scientific Claim Unlearning and present a new benchmark, SciUnlearn. We show that current unlearning approaches are unable to effectively eliminate claim-level knowledge and often achieve only superficial suppression, highlighting the need for specialized methods designed for structured knowledge removal.

📄 PDF Abstract BibTeX arXiv:2608.20960

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Expressing High-Level Scientific Claims with Formal Semantics

2021-09-27 · Cristina-Iulia Bucur, Tobias Kuhn, Davide Ceolin, Jacco van Ossenbruggen

The use of semantic technologies is gaining significant traction in science communication with a wide array of applications in disciplines including the Life Sciences, Computer Science, and the Social Sciences. Languages…

ArticlesFormal LogicVocal Bursts Intensity Prediction

Awes, Laws, and Flaws From Today's LLM Research

2024-08-27 · Adrian de Wynter

We perform a critical examination of the scientific methodology behind contemporary large language model (LLM) research. For this we assess over 2,000 research works based on criteria typical of what is considered good r…

EthicsLanguage ModelingLanguage ModellingLarge Language Model

MuSciClaims: Multimodal Scientific Claim Verification

2025-06-05 · Yash Kumar Lal, Manikanta Bandham, Mohammad Saqib Hasan, Apoorva Kashi 외

Assessing scientific claims requires identifying, extracting, and reasoning with multimodal data expressed in information-rich figures in scientific literature. Despite the large body of work in scientific QA, figure cap…

ArticlesClaim VerificationDiagnosticMultimodal Reasoning

Can AI Validate Science? Benchmarking LLMs for Accurate Scientific Claim $\rightarrow$ Evidence Reasoning

2025-06-09 · Shashidhar Reddy Javaji, Yupeng Cao, Haohang Li, Yangyang Yu 외

Large language models (LLMs) are increasingly being used for complex research tasks such as literature review, idea generation, and scientific paper analysis, yet their ability to truly understand and process the intrica…

BenchmarkingDiagnostic

NSF-SciFy: Mining the NSF Awards Database for Scientific Claims

2025-03-11 · Delip Rao, Weiqiu You, Eric Wong, Chris Callison-Burch

We present NSF-SciFy, a large-scale dataset for scientific claim extraction derived from the National Science Foundation (NSF) awards database, comprising over 400K grant abstracts spanning five decades. While previous d…

16kAbstract generationClaim Verification