paper-with-me

홈 › Papers

Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibration

2026-04-11 · Hang Lv, Hongchao Gu, Ruiqing Yang, Liangyue Li, Zulong Chen, Defu Lian, Hao Wang, Enhong Chen arxiv

Generative listwise reranking leverages global context for superior retrieval but is plagued by intrinsic position bias, where models exhibit structural sensitivity to input order independent of relevance. Existing mitigations present a dilemma: inference-time aggregation incurs prohibitive latency, while training-based methods often fail to eradicate ingrained priors, particularly in compact models. To resolve this dilemma, we propose CapCal (Content-Agnostic Probability Calibration), a training-free framework that mechanically decouples positional bias from ranking decisions. By estimating the bias distribution via content-free placeholders, CapCal rectifies output logits through an entropy-adaptive contrastive mechanism. Evaluations across 10 benchmarks confirm that CapCal achieves superior performance among training-free methods while preserving single-pass efficiency. Notably, it unlocks the latent potential of lightweight models (e.g., 0.6B), delivering absolute NDCG gains exceeding 10 points and outperforming both permutation-based aggregation and data-augmentation baselines.

📄 PDF Abstract BibTeX arXiv:2604.10150

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Rank-without-GPT: Building GPT-Independent Listwise Rerankers on Open-Source Large Language Models

2023-12-05 · Xinyu Zhang, Sebastian Hofstätter, Patrick Lewis, Raphael Tang 외

Listwise rerankers based on large language models (LLM) are the zero-shot state-of-the-art. However, current works in this direction all depend on the GPT models, making it a single point of failure in scientific reprodu…

Passage RetrievalRetrieval

Guiding Retrieval using LLM-based Listwise Rankers

2025-01-15 · Mandeep Rathee, Sean MacAvaney, Avishek Anand

Large Language Models (LLMs) have shown strong promise as rerankers, especially in ``listwise'' settings where an LLM is prompted to rerank several search results at once. However, this ``cascading'' retrieve-and-rerank …

Retrieval

FIRST: Faster Improved Listwise Reranking with Single Token Decoding

2024-06-21 · Revanth Gangi Reddy, JaeHyeok Doo, Yifei Xu, Md Arafat Sultan 외

Large Language Models (LLMs) have significantly advanced the field of information retrieval, particularly for reranking. Listwise LLM rerankers have showcased superior performance and generalizability compared to existin…

Information RetrievalLanguage ModelingLanguage ModellingLearning-To-Rank+1

Rank-K: Test-Time Reasoning for Listwise Reranking

2025-05-20 · Eugene Yang, Andrew Yates, Kathryn Ricci, Orion Weller 외

Retrieve-and-rerank is a popular retrieval pipeline because of its ability to make slow but effective rerankers efficient enough at query time by reducing the number of comparisons. Recent works in neural rerankers take …

Language ModelingLanguage ModellingPassage RerankingReranking+1

E2Rank: Unifying Text Embedding and Listwise Reranking for Effective and Efficient Search

2025-10-26 · Qi Liu, Yanzhao Zhang, Mingxin Li, Dingkun Long 외 arxiv

Text embedding models deliver competitive retrieval performance with high efficiency, but their ranking fidelity remains limited compared to LLM-based listwise rerankers, which capture fine-grained query-document and doc…

Computational Efficiency