paper-with-me

홈 › Papers

Generative Pseudo-Labeling for Pre-Ranking with LLMs

2026-02-24 · Junyu Bi, Xinting Niu, Daixuan Cheng, Kun Yuan, Tao Wang, Binbin Cao, Jian Wu arxiv

Pre-ranking is a critical stage in industrial recommendation systems, tasked with efficiently scoring thousands of recalled items for downstream ranking. A key challenge is the train-serving discrepancy: pre-ranking models are trained only on exposed interactions, yet must score all recalled candidates -- including unexposed items -- during online serving. This mismatch not only induces severe sample selection bias but also degrades generalization, especially for long-tail content. Existing debiasing approaches typically rely on heuristics (e.g., negative sampling) or distillation from biased rankers, which either mislabel plausible unexposed items as negatives or propagate exposure bias into pseudo-labels. In this work, we propose Generative Pseudo-Labeling (GPL), a framework that leverages large language models (LLMs) to generate unbiased, content-aware pseudo-labels for unexposed items, explicitly aligning the training distribution with the online serving space. By offline generating user-specific interest anchors and matching them with candidates in a frozen semantic space, GPL provides high-quality supervision without adding online latency. Deployed in a large-scale production system, GPL improves click-through rate by 3.07%, while significantly enhancing recommendation diversity and long-tail item discovery.

📄 PDF Abstract BibTeX arXiv:2602.20995

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems

Similar Papers 제목 키워드 기반

MAPLE: Many-Shot Adaptive Pseudo-Labeling for In-Context Learning

2025-05-22 · Zihan Chen, Song Wang, Zhen Tan, Jundong Li 외

In-Context Learning (ICL) empowers Large Language Models (LLMs) to tackle diverse tasks by incorporating multiple input-output examples, known as demonstrations, into the input of LLMs. More recently, advancements in the…

In-Context Learning

MMCIG: Multimodal Cover Image Generation for Text-only Documents and Its Dataset Construction via Pseudo-labeling

2025-08-24 · Hyeyeon Kim, Sungwoo Han, Jingun Kwon, Hidetaka Kamigaito 외 arxiv

In this study, we introduce a novel cover image generation task that produces both a concise summary and a visually corresponding image from a given text-only document. Because no existing datasets are available for this…

Image Generation

Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing

2024-04-17 · Le Yan, Zhen Qin, Honglei Zhuang, Rolf Jagerman 외

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevan…

Remining Hard Negatives for Generative Pseudo Labeled Domain Adaptation

2025-01-24 · Goksenin Yuksel, David Rau, Jaap Kamps

Dense retrievers have demonstrated significant potential for neural information retrieval; however, they exhibit a lack of robustness to domain shifts, thereby limiting their efficacy in zero-shot settings across diverse…

Domain AdaptationInformation RetrievalKnowledge Distillation

Generative Relevance Feedback and Convergence of Adaptive Re-Ranking: University of Glasgow Terrier Team at TREC DL 2023

2024-05-02 · Andrew Parry, Thomas Jaenich, Sean MacAvaney, Iadh Ounis

This paper describes our participation in the TREC 2023 Deep Learning Track. We submitted runs that apply generative relevance feedback from a large language model in both a zero-shot and pseudo-relevance feedback settin…

Language ModelingLanguage ModellingLarge Language ModelRe-Ranking+1