paper-with-me

홈 › Papers

Contrastive Information Transfer for Pre-Ranking Systems

2022-07-07 · Yue Cao, Xiaojiang Zhou, Peihao Huang, Yao Xiao, Dayao Chen, Sheng Chen

Real-word search and recommender systems usually adopt a multi-stage ranking architecture, including matching, pre-ranking, ranking, and re-ranking. Previous works mainly focus on the ranking stage while very few focus on the pre-ranking stage. In this paper, we focus on the information transfer from ranking to pre-ranking stage. We propose a new Contrastive Information Transfer (CIT) framework to transfer useful information from ranking model to pre-ranking model. We train the pre-ranking model to distinguish the positive pair of representation from a set of positive and negative pairs with a contrastive objective. As a consequence, the pre-ranking model can make full use of rich information in ranking model's representations. The CIT framework also has the advantage of alleviating selection bias and improving the performance of recall metrics, which is crucial for pre-ranking models. We conduct extensive experiments including offline datasets and online A/B testing. Experimental results show that CIT achieves superior results than competitive models. In addition, a strict online A/B testing at one of the world's largest E-commercial platforms shows that the proposed model achieves 0.63\% improvements on CTR and 1.64\% improvements on VBR. The proposed model now has been deployed online and serves the main traffic of this system, contributing a remarkable business growth.

📄 PDF Abstract BibTeX arXiv:2207.03073

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation SystemsRe-RankingSelection bias

Similar Papers 제목 키워드 기반

Evaluative Item-Contrastive Explanations in Rankings

2023-12-14 · Alessandro Castelnovo, Riccardo Crupi, Nicolò Mombelli, Gabriele Nanino 외

The remarkable success of Artificial Intelligence in advancing automated decision-making is evident both in academia and industry. Within the plethora of applications, ranking systems hold significant importance in vario…

Decision Making

RankCSE: Unsupervised Representation Learning via Learning to Rank

2022-11-14 · Anonymous

Unsupervised sentence representation learning is one of the fundamental problems in natural language processing with various downstream applications. Recently, contrastive learning has been widely adopted which derives h…

Contrastive LearningLearning-To-RankRepresentation LearningSemantic Textual Similarity+2

RankCSE: Unsupervised Sentence Representations Learning via Learning to Rank

2023-05-26 · Jiduan Liu, Jiahao Liu, Qifan Wang, Jingang Wang 외

Unsupervised sentence representation learning is one of the fundamental problems in natural language processing with various downstream applications. Recently, contrastive learning has been widely adopted which derives h…

Contrastive LearningLearning-To-RankRepresentation LearningSemantic Textual Similarity+2

Generalized Contrastive Learning for Multi-Modal Retrieval and Ranking

2024-04-12 · Tianyu Zhu, Myong Chol Jung, Jesse Clark

Contrastive learning has gained widespread adoption for retrieval tasks due to its minimal requirement for manual annotations. However, popular training frameworks typically learn from binary (positive/negative) relevanc…

Contrastive LearningRetrieval

How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval?

2024-07-10 · CVPR 2024 1 · Yuxin Chen, Zongyang Ma, Ziqi Zhang, Zhongang Qi 외

Dominant dual-encoder models enable efficient image-text retrieval but suffer from limited accuracy while the cross-encoder models offer higher accuracy at the expense of efficiency. Distilling cross-modality matching kn…

Contrastive LearningImage-text RetrievalRetrievalText Retrieval+2