Context Shapes LLMs Retrieval-Augmented Fact-Checking Effectiveness

2026-02-15 · Pietro Bernardelle, Stefano Civelli, Kevin Roitero, Gianluca Demartini arxiv

Large language models (LLMs) show strong reasoning abilities across diverse tasks, yet their performance on extended contexts remains inconsistent. While prior research has emphasized mid-context degradation in question answering, this study examines the impact of context in LLM-based fact verification. Using three datasets (HOVER, FEVEROUS, and ClimateFEVER) and five open-source models accross different parameters sizes (7B, 32B and 70B parameters) and model families (Llama-3.1, Qwen2.5 and Qwen3), we evaluate both parametric factual knowledge and the impact of evidence placement across varying context lengths. We find that LLMs exhibit non-trivial parametric knowledge of factual claims and that their verification accuracy generally declines as context length increases. Similarly to what has been shown in previous works, in-context evidence placement plays a critical role with accuracy being consistently higher when relevant evidence appears near the beginning or end of the prompt and lower when placed mid-context. These results underscore the importance of prompt structure in retrieval-augmented fact-checking systems.

📄 PDF Abstract BibTeX arXiv:2602.14044

Code (0)

등록된 구현이 없습니다.

Tasks

Question Answering Fact Verification

How Retrieved Context Shapes Internal Representations in RAG

2026-02-23 · Samuel Yeh, Sharon Li arxiv

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by conditioning generation on retrieved external documents, but the effect of retrieved context is often non-trivial. In realistic retrieval sett…

Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts

2025-02-24 · Zhenghao Liu, Xingsheng Zhu, Tianshuo Zhou, Xinyi Zhang 외

This paper introduces Multi-Modal Retrieval-Augmented Generation (M^2RAG), a benchmark designed to evaluate the effectiveness of Multi-modal Large Language Models (MLLMs) in leveraging knowledge from multi-modal retrieva…

Benchmarking Fact Verification Image Captioning Question Answering+4

Improving Context Fidelity via Native Retrieval-Augmented Reasoning

2025-09-17 · Suyuchen Wang, Jinlin Wang, Xinyu Wang, Shiqi Li 외 arxiv

Large language models (LLMs) often struggle with context fidelity, producing inconsistent answers when responding to questions based on provided information. Existing approaches either rely on expensive supervised fine-t…

Answer Generation

LongRAG: A Dual-Perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering

2024-10-23 · Qingfei Zhao, Ruobing Wang, Yukuo Cen, Daren Zha 외

Long-Context Question Answering (LCQA), a challenging task, aims to reason over long-context documents to yield accurate answers to questions. Existing long-context Large Language Models (LLMs) for LCQA often struggle wi…

Chunking Question Answering RAG Retrieval+1

Dehallucinating Parallel Context Extension for Retrieval-Augmented Generation

2024-12-19 · Zexiong Ma, Shengnan An, Zeqi Lin, Yanzhen Zou 외

Large language models (LLMs) are susceptible to generating hallucinated information, despite the integration of retrieval-augmented generation (RAG). Parallel context extension (PCE) is a line of research attempting to e…

Hallucination RAG Retrieval Retrieval-augmented Generation