paper-with-me

홈 › Papers

A Large Scale Search Dataset for Unbiased Learning to Rank

2022-07-07 · Lixin Zou, Haitao Mao, Xiaokai Chu, Jiliang Tang, Wenwen Ye, Shuaiqiang Wang, Dawei Yin

The unbiased learning to rank (ULTR) problem has been greatly advanced by recent deep learning techniques and well-designed debias algorithms. However, promising results on the existing benchmark datasets may not be extended to the practical scenario due to the following disadvantages observed from those popular benchmark datasets: (1) outdated semantic feature extraction where state-of-the-art large scale pre-trained language models like BERT cannot be exploited due to the missing of the original text;(2) incomplete display features for in-depth study of ULTR, e.g., missing the displayed abstract of documents for analyzing the click necessary bias; (3) lacking real-world user feedback, leading to the prevalence of synthetic datasets in the empirical study. To overcome the above disadvantages, we introduce the Baidu-ULTR dataset. It involves randomly sampled 1.2 billion searching sessions and 7,008 expert annotated queries, which is orders of magnitude larger than the existing ones. Baidu-ULTR provides:(1) the original semantic feature and a pre-trained language model for easy usage; (2) sufficient display information such as position, displayed height, and displayed abstract, enabling the comprehensive study of different biases with advanced techniques such as causal discovery and meta-learning; and (3) rich user feedback on search result pages (SERPs) like dwelling time, allowing for user engagement optimization and promoting the exploration of multi-task learning in ULTR. In this paper, we present the design principle of Baidu-ULTR and the performance of benchmark ULTR algorithms on this new data resource, favoring the exploration of ranking for long-tail queries and pre-training tasks for ranking. The Baidu-ULTR dataset and corresponding baseline implementation are available at https://github.com/ChuXiaokai/baidu_ultr_dataset.

📄 PDF Abstract BibTeX arXiv:2207.03051

Code (1)

chuxiaokai/baidu_ultr_dataset 공식 구현 pytorch

Tasks

Causal DiscoveryLanguage ModellingLearning-To-RankMeta-LearningMulti-Task Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Weight Decay 설명 없음
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

Unbiased Learning to Rank Meets Reality: Lessons from Baidu's Large-Scale Search Dataset

2024-04-03 · Philipp Hager, Romain Deffayet, Jean-Michel Renders, Onno Zoeter 외

Unbiased learning-to-rank (ULTR) is a well-established framework for learning from user clicks, which are often biased by the ranker collecting the data. While theoretically justified and extensively tested in simulation…

Learning-To-Rank

Analysis of Multivariate Scoring Functions for Automatic Unbiased Learning to Rank

2020-08-20 · Tao Yang, Shikai Fang, Shibo Li, Yulan Wang 외

Leveraging biased click data for optimizing learning to rank systems has been a popular approach in information retrieval. Because click data is often noisy and biased, a variety of methods have been proposed to construc…

Information RetrievalLearning-To-RankRetrieval

Unbiased Learning to Rank: Online or Offline?

2020-04-28 · Qingyao Ai, Tao Yang, Huazheng Wang, Jiaxin Mao

How to obtain an unbiased ranking model by learning to rank with biased user feedback is an important research question for IR. Existing work on unbiased learning to rank (ULTR) can be broadly categorized into two groups…

Learning-To-Rank

Unbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm

2018-09-16 · Ziniu Hu, Yang Wang, Qu Peng, Hang Li

Although click data is widely used in search systems in practice, so far the inherent bias, most notably position bias, has prevented it from being used in training of a ranker for search, i.e., learning-to-rank. Recentl…

Learning-To-RankPosition

Unbiased Learning to Rank with Biased Continuous Feedback

2023-03-08 · Yi Ren, Hongyan Tang, Siwen Zhu

It is a well-known challenge to learn an unbiased ranker with biased feedback. Unbiased learning-to-rank(LTR) algorithms, which are verified to model the relative relevance accurately based on noisy feedback, are appeali…

Learning-To-RankPositionRecommendation Systems