paper-with-me

홈 › Papers

Contextual Dual Learning Algorithm with Listwise Distillation for Unbiased Learning to Rank

2024-08-19 · Lulu Yu, Keping Bi, Shiyu Ni, Jiafeng Guo

Unbiased Learning to Rank (ULTR) aims to leverage biased implicit user feedback (e.g., click) to optimize an unbiased ranking model. The effectiveness of the existing ULTR methods has primarily been validated on synthetic datasets. However, their performance on real-world click data remains unclear. Recently, Baidu released a large publicly available dataset of their web search logs. Subsequently, the NTCIR-17 ULTRE-2 task released a subset dataset extracted from it. We conduct experiments on commonly used or effective ULTR methods on this subset to determine whether they maintain their effectiveness. In this paper, we propose a Contextual Dual Learning Algorithm with Listwise Distillation (CDLA-LD) to simultaneously address both position bias and contextual bias. We utilize a listwise-input ranking model to obtain reconstructed feature vectors incorporating local contextual information and employ the Dual Learning Algorithm (DLA) method to jointly train this ranking model and a propensity model to address position bias. As this ranking model learns the interaction information within the documents list of the training set, to enhance the ranking model's generalization ability, we additionally train a pointwise-input ranking model to learn the listwise-input ranking model's capability for relevance judgment in a listwise manner. Extensive experiments and analysis confirm the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2408.09817

Code (0)

등록된 구현이 없습니다.

Tasks

Learning-To-RankPosition

Similar Papers 제목 키워드 기반

Calibration-compatible Listwise Distillation of Privileged Features for CTR Prediction

2023-12-14 · Xiaoqiang Gui, Yueyao Cheng, Xiang-Rong Sheng, Yunfeng Zhao 외

In machine learning systems, privileged features refer to the features that are available during offline training but inaccessible for online serving. Previous studies have recognized the importance of privileged feature…

Click-Through Rate Prediction

ARSM Gradient Estimator for Supervised Learning to Rank

2019-11-01 · Siamak Zamani Dadaneh, Shahin Boluki, Mingyuan Zhou, Xiaoning Qian

We propose a new model for supervised learning to rank. In our model, the relevance labels are assumed to follow a categorical distribution whose probabilities are constructed based on a scoring function. We optimize the…

Learning-To-Rank

Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detection

2023-12-02 · Jiayang Li, Xuan Feng, Tianlong Gu, Liang Chang

Multi-domain fake news detection aims to identify whether various news from different domains is real or fake and has become urgent and important. However, existing methods are dedicated to improving the overall performa…

Fake News DetectionKnowledge Distillation

RIA: A Ranking-Infused Approach for Optimized listwise CTR Prediction

2025-11-26 · Guoxiao Zhang, Tan Qu, Ao Li, DongLin Ni 외 arxiv

Reranking improves recommendation quality by modeling item interactions. However, existing methods often decouple ranking and reranking, leading to weak listwise evaluation models that suffer from combinatorial sparsity …

DeAR: Dual-Stage Document Reranking with Reasoning Agents via LLM Distillation

2025-08-23 · Abdelrahman Abdallah, Jamshid Mozafari, Bhawna Piryani, Adam Jatowt arxiv

Large Language Models (LLMs) have transformed listwise document reranking by enabling global reasoning over candidate sets, yet single models often struggle to balance fine-grained relevance scoring with holistic cross-d…

Natural Questions