paper-with-me

홈 › Papers

Beyond Relevance: Utility-Centric Retrieval in the LLM Era

2026-04-10 · Hengran Zhang, Minghao Tang, Keping Bi, Jiafeng Guo arxiv

Information retrieval systems have traditionally optimized for topical relevance-the degree to which retrieved documents match a query. However, relevance only approximates a deeper goal: utility, namely, whether retrieved information helps accomplish a user's underlying task. The emergence of retrieval-augmented generation (RAG) fundamentally changes this paradigm. Retrieved documents are no longer consumed directly by users but instead serve as evidence for large language models (LLMs) that produce answers. As a result, retrieval effectiveness must be evaluated by its contribution to generation quality rather than by relevance-based ranking metrics alone. This tutorial argues that retrieval objectives are evolving from relevance-centric optimization toward LLM-centric utility. We present a unified framework covering LLM-agnostic versus LLM-specific utility, context-independent versus context-dependent utility, and the connection with LLM information needs and agentic RAG. By synthesizing recent advances, the tutorial provides conceptual foundations and practical guidance for designing retrieval systems aligned with the requirements of LLM-based information access.

📄 PDF Abstract BibTeX arXiv:2604.08920

Code (0)

등록된 구현이 없습니다.

Tasks

Information Retrieval

Similar Papers 제목 키워드 기반

Iterative Utility Judgment Framework via LLMs Inspired by Relevance in Philosophy

2024-06-17 · Hengran Zhang, Keping Bi, Jiafeng Guo, Xueqi Cheng

Utility and topical relevance are critical measures in information retrieval (IR), reflecting system and user perspectives, respectively. While topical relevance has long been emphasized, utility is a higher standard of …

Answer GenerationInformation RetrievalPassage RetrievalPhilosophy+4

Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation

2026-05-02 · Peiyang Liu, Qiang Yan, Ziqiang Cui, Di Liang 외 arxiv

Standard Retrieval-Augmented Generation (RAG) systems predominantly rely on semantic relevance as a proxy for utility. However, this assumption collapses in realistic decision-making scenarios where user queries are lade…

Distilling a Small Utility-Based Passage Selector to Enhance Retrieval-Augmented Generation

2025-07-25 · Hengran Zhang, Keping Bi, Jiafeng Guo, Jiaming Zhang 외 arxiv

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating retrieved information. Standard retrieval process prioritized relevance, focusing on topical alignment between queries and passa…

Answer Generation

Beyond Semantic Similarity: A Two-Phase Non-Parametric Retrieval Workflow for Corporate Credit Underwriting

2026-05-20 · Linus Ng Junjia, Ezekiel Tee Kongquan, Kelvin Heng, Kenneth Zhu Ke 외 arxiv

Corporate credit underwriting requires analysts to extract actionable evidence from long, heterogeneous financial documents spanning hundreds of pages and multiple languages. Standard Retrieval-Augmented Generation (RAG)…

Semantic Similarity

Scoring Is Not Enough: Addressing Gaps in Utility-fairness Trade-offs for Ranking

2026-06-24 · Shubham Singh, Ian A. Kash, Mesrob I. Ohannessian arxiv

Scoring functions are used to represent the relevance of individual documents. In modern information retrieval or recommendation systems, they are often learned from data and play a pivotal role in ranking sets of docume…

Recommendation SystemsInformation Retrieval