+VeriRel: Verification Feedback to Enhance Document Retrieval for Scientific Fact Checking
Identification of appropriate supporting evidence is critical to the success of scientific fact checking. However, existing approaches rely on off-the-shelf Information Retrieval algorithms that rank documents based on relevance rather than the evidence they provide to support or refute the claim being checked. This paper proposes +VeriRel which includes verification success in the document ranking. Experimental results on three scientific fact checking datasets (SciFact, SciFact-Open and Check-Covid) demonstrate consistently leading performance by +VeriRel for document evidence retrieval and a positive impact on downstream verification. This study highlights the potential of integrating verification feedback to document relevance assessment for effective scientific fact checking systems. It shows promising future work to evaluate fine-grained relevance when examining complex documents for advanced scientific fact checking.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalDocument RankingFact CheckingSimilar Papers 제목 키워드 기반
Reinforcement Retrieval Leveraging Fine-grained Feedback for Fact Checking News Claims with Black-Box LLM
Retrieval-augmented language models have exhibited promising performance across various areas of natural language processing (NLP), including fact-critical tasks. However, due to the black-box nature of advanced large la…
Claim VerificationFact CheckingRetrievalFrom Relevance to Utility: Evidence Retrieval with Feedback for Fact Verification
Retrieval-enhanced methods have become a primary approach in fact verification (FV); it requires reasoning over multiple retrieved pieces of evidence to verify the integrity of a claim. To retrieve evidence, existing wor…
Fact VerificationRetrievalPseudo-Relevance Feedback for Multiple Representation Dense Retrieval
Pseudo-relevance feedback mechanisms, from Rocchio to the relevance models, have shown the usefulness of expanding and reweighting the users' initial queries using information occurring in an initial set of retrieved doc…
Information RetrievalPassage RankingRerankingRetrieval+1UKP-Athene: Multi-Sentence Textual Entailment for Claim Verification
The Fact Extraction and VERification (FEVER) shared task was launched to support the development of systems able to verify claims by extracting supporting or refuting facts from raw text. The shared task organizers provi…
Claim VerificationEntity LinkingGeneral ClassificationNatural Language Inference+2When, What, and How: Rethinking Retrieval-Enhanced Speculative Decoding
Speculative decoding (SD) has emerged as an effective technique to accelerate large language model (LLM) inference without compromising output quality. However, the achievable speedup largely depends on the effectiveness…