paper-with-me

홈 › Papers

Joint Optimization of Ranking and Calibration with Contextualized Hybrid Model

2022-08-12 · Xiang-Rong Sheng, Jingyue Gao, Yueyao Cheng, Siran Yang, Shuguang Han, Hongbo Deng, Yuning Jiang, Jian Xu, Bo Zheng

Despite the development of ranking optimization techniques, pointwise loss remains the dominating approach for click-through rate prediction. It can be attributed to the calibration ability of the pointwise loss since the prediction can be viewed as the click probability. In practice, a CTR prediction model is also commonly assessed with the ranking ability. To optimize the ranking ability, ranking loss (e.g., pairwise or listwise loss) can be adopted as they usually achieve better rankings than pointwise loss. Previous studies have experimented with a direct combination of the two losses to obtain the benefit from both losses and observed an improved performance. However, previous studies break the meaning of output logit as the click-through rate, which may lead to sub-optimal solutions. To address this issue, we propose an approach that can Jointly optimize the Ranking and Calibration abilities (JRC for short). JRC improves the ranking ability by contrasting the logit value for the sample with different labels and constrains the predicted probability to be a function of the logit subtraction. We further show that JRC consolidates the interpretation of logits, where the logits model the joint distribution. With such an interpretation, we prove that JRC approximately optimizes the contextualized hybrid discriminative-generative objective. Experiments on public and industrial datasets and online A/B testing show that our approach improves both ranking and calibration abilities. Since May 2022, JRC has been deployed on the display advertising platform of Alibaba and has obtained significant performance improvements.

📄 PDF Abstract BibTeX arXiv:2208.06164

Code (1)

alibaba/TorchEasyRec pytorch

Tasks

Click-Through Rate Prediction

Similar Papers 제목 키워드 기반

SynerGen: Contextualized Generative Recommender for Unified Search and Recommendation

2025-09-26 · Vianne R. Gao, Chen Xue, Marc Versage, Xie Zhou 외 arxiv

The dominant retrieve-then-rank pipeline in large-scale recommender systems suffers from mis-calibration and engineering overhead due to its architectural split and differing optimization objectives. While recent generat…

CEDR: Contextualized Embeddings for Document Ranking

2019-04-15 · Sean MacAvaney, Andrew Yates, Arman Cohan, Nazli Goharian

Although considerable attention has been given to neural ranking architectures recently, far less attention has been paid to the term representations that are used as input to these models. In this work, we investigate h…

Ad-Hoc Information RetrievalDocument RankingGeneral Classification

Semantic Specialization for Knowledge-based Word Sense Disambiguation

2023-04-22 · Sakae Mizuki, Naoaki Okazaki

A promising approach for knowledge-based Word Sense Disambiguation (WSD) is to select the sense whose contextualized embeddings computed for its definition sentence are closest to those computed for a target word in a gi…

Language ModellingRerankingSentenceWord Sense Disambiguation

GRAFT: Decoupling Ranking and Calibration for Survival Analysis

2026-02-08 · Mohammad Ashhad, Robert Hoehndorf, Ricardo Henao arxiv

Survival analysis is complicated by censored data, high-dimensional features, and non-linear interactions. Classical models offer interpretability and superior calibration but are restricted to linear or predefined funct…

ResRank: Unifying Retrieval and Listwise Reranking via End-to-End Joint Training with Residual Passage Compression

2026-04-24 · Xiaojie Ke, Shuai Zhang, Liansheng Sun, Yongjin Wang 외 arxiv

Large language model (LLM) based listwise reranking has emerged as the dominant paradigm for achieving state-of-the-art ranking effectiveness in information retrieval. However, its reliance on feeding full passage texts …

Information Retrieval