paper-with-me

홈 › Papers

Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation

2026-05-02 · Peiyang Liu, Qiang Yan, Ziqiang Cui, Di Liang, Xi Wang, Wei Ye arxiv

Standard Retrieval-Augmented Generation (RAG) systems predominantly rely on semantic relevance as a proxy for utility. However, this assumption collapses in realistic decision-making scenarios where user queries are laden with cognitive biases, such as false premises or confirmation bias. In such cases, maximizing relevance paradoxically promotes the retrieval of sycophantic evidence that reinforces hallucinations, a critical failure we term the ``Relevance-Robustness Gap''. To bridge this gap, we propose CoRM-RAG (Counterfactual Risk Minimization for RAG), a framework that aligns retrieval with decision safety rather than mere similarity. Grounded in causal intervention, we introduce a Cognitive Perturbation Protocol to simulate user biases during training, which is then distilled into a lightweight Evidence Critic. This scoring module learns to identify documents that possess sufficient evidential strength to steer the model toward correctness despite adversarial query perturbations. Extensive experiments on decision-making benchmarks demonstrate that CoRM-RAG significantly outperforms strong dense retrievers and LLM-based rerankers in adversarial settings, while enabling effective risk-aware abstention through reliable robustness scoring. Our code is available at https://github.com/PeiYangLiu/CoRM-RAG.git.

📄 PDF Abstract BibTeX arXiv:2605.01302

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Distributionally Robust Counterfactual Risk Minimization

2019-06-14 · Louis Faury, Ugo Tanielian, Flavian vasile, Elena Smirnova 외

This manuscript introduces the idea of using Distributionally Robust Optimization (DRO) for the Counterfactual Risk Minimization (CRM) problem. Tapping into a rich existing literature, we show that DRO is a principled to…

counterfactualDecision Making

Sequential Counterfactual Risk Minimization

2023-02-23 · Houssam Zenati, Eustache Diemert, Matthieu Martin, Julien Mairal 외

Counterfactual Risk Minimization (CRM) is a framework for dealing with the logged bandit feedback problem, where the goal is to improve a logging policy using offline data. In this paper, we explore the case where it is …

counterfactual

Bayesian Counterfactual Risk Minimization

2018-06-29 · Ben London, Ted Sandler

We present a Bayesian view of counterfactual risk minimization (CRM) for offline learning from logged bandit feedback. Using PAC-Bayesian analysis, we derive a new generalization bound for the truncated inverse propensit…

counterfactual

Counterfactual Risk Minimization: Learning from Logged Bandit Feedback

2015-02-09 · Adith Swaminathan, Thorsten Joachims

We develop a learning principle and an efficient algorithm for batch learning from logged bandit feedback. This learning setting is ubiquitous in online systems (e.g., ad placement, web search, recommendation), where an …

counterfactualMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Beyond Task-Only Matching: Personalized Skill Routing with Counterfactual Evaluation

2026-08-28 · Tianle Wang, Yanghe Zou, Xiang Liu, Ziyao Huang 외 arxiv

The rapid expansion of reusable skill repositories makes skill routing a critical capability for large language model (LLM) agents. Existing methods treat routing as task-only semantic matching. However, when users with …