paper-with-me

Papers

Investigating Context-Faithfulness in Large Language Models: The Roles of Memory Strength and Evidence Style

2024-09-17 · Yuepei Li, Kang Zhou, Qiao Qiao, Bach Nguyen, Qing Wang, Qi Li

Retrieval-augmented generation (RAG) improves Large Language Models (LLMs) by incorporating external information into the response generation process. However, how context-faithful LLMs are and what factors influence LLMs' context-faithfulness remain largely unexplored. In this study, we investigate the impact of memory strength and evidence presentation on LLMs' receptiveness to external evidence. We introduce a method to quantify the memory strength of LLMs by measuring the divergence in LLMs' responses to different paraphrases of the same question, which is not considered by previous works. We also generate evidence in various styles to evaluate the effects of evidence in different styles. Two datasets are used for evaluation: Natural Questions (NQ) with popular questions and popQA featuring long-tail questions. Our results show that for questions with high memory strength, LLMs are more likely to rely on internal memory, particularly for larger LLMs such as GPT-4. On the other hand, presenting paraphrased evidence significantly increases LLMs' receptiveness compared to simple repetition or adding details.

📄 PDF Abstract BibTeX arXiv:2409.10955

Code (0)

등록된 구현이 없습니다.

Tasks

Natural QuestionsRAGResponse GenerationRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Investigating the Interplay between Contextual and Parametric Chain-of-Thought Faithfulness under Optimization

2026-05-24 · Jingyi Sun, Qianli Wang, Pepa Atanasova, Nils Feldhus 외 arxiv

Chain-of-Thought (CoT) faithfulness, i.e., whether CoTs genuinely reflect large language models' (LLM) underlying behavior, is typically evaluated with metrics under two disjoint paradigms: contextual faithfulness, measu…

Investigating Faithfulness in Large Audio Language Models

2025-09-26 · Pooneh Mousavi, Lovenya Jain, Mirco Ravanelli, Cem Subakan arxiv

Large Audio Language Models (LALMs) integrate audio encoders with pretrained Large Language Models to perform complex multimodal reasoning tasks. While these models can generate Chain-of-Thought (CoT) explanations, the f…

Multimodal Reasoning

Can Large Language Models Still Explain Themselves? Investigating the Impact of Quantization on Self-Explanations

2026-01-01 · Qianli Wang, Nils Feldhus, Pepa Atanasova, Fedor Splitt 외 arxiv

Quantization is widely used to accelerate inference and streamline the deployment of large language models (LLMs), yet its effects on self-explanations (SEs) remain unexplored. SEs, generated by LLMs to justify their own…

Model Compression

FaMeSumm: Investigating and Improving Faithfulness of Medical Summarization

2023-11-03 · Nan Zhang, Yusen Zhang, Wu Guo, Prasenjit Mitra 외

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and impr…

Contrastive Learning

Does Role Specialization Matter for Explanation Faithfulness in Mixture-of-Experts?

2026-06-28 · Yeji Kim, Housam Babiker, Mi-Young Kim, Randy Goebel arxiv

Mixture-of-Experts (MoE) architectures have recently been extended with role-based mechanisms for interpretability. This is typically done by assigning semantic roles to individual expert components, for example roles li…