Handling Position Bias for Unbiased Learning to Rank in Hotels Search
Nowadays, search ranking and recommendation systems rely on a lot of data to train machine learning models such as Learning-to-Rank (LTR) models to rank results for a given query, and implicit user feedbacks (e.g. click data) have become the dominant source of data collection due to its abundance and low cost, especially for major Internet companies. However, a drawback of this data collection approach is the data could be highly biased, and one of the most significant biases is the position bias, where users are biased towards clicking on higher ranked results. In this work, we will investigate the marginal importance of properly handling the position bias in an online test environment in Tripadvisor Hotels search. We propose an empirically effective method of handling the position bias that fully leverages the user action data. We take advantage of the fact that when user clicks a result, he has almost certainly observed all the results above, and the propensities of the results below the clicked result will be estimated by a simple but effective position bias model. The online A/B test results show that this method leads to an improved search ranking model.
Code (0)
등록된 구현이 없습니다.
Tasks
Learning-To-RankPositionRecommendation SystemsSimilar Papers 제목 키워드 기반
Unbiased Top-k Learning to Rank with Causal Likelihood Decomposition
Unbiased learning to rank has been proposed to alleviate the biases in the search ranking, making it possible to train ranking models with user interaction data. In real applications, search engines are designed to displ…
Learning-To-RankPositionSelection biasUnbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm
Although click data is widely used in search systems in practice, so far the inherent bias, most notably position bias, has prevented it from being used in training of a ranker for search, i.e., learning-to-rank. Recentl…
Learning-To-RankPositionAn IPW-based Unbiased Ranking Metric in Two-sided Markets
In modern recommendation systems, unbiased learning-to-rank (LTR) is crucial for prioritizing items from biased implicit user feedback, such as click data. Several techniques, such as Inverse Propensity Weighting (IPW), …
Learning-To-RankPositionRecommendation SystemsDoubly-Robust Estimation for Correcting Position-Bias in Click Feedback for Unbiased Learning to Rank
Clicks on rankings suffer from position-bias: generally items on lower ranks are less likely to be examined - and thus clicked - by users, in spite of their actual preferences between items. The prevalent approach to unb…
counterfactualGeneral Reinforcement LearningLearning-To-RankPositionA General Framework for Pairwise Unbiased Learning to Rank
Pairwise debiasing is one of the most effective strategies in reducing position bias in learning-to-rank (LTR) models. However, limiting the scope of this strategy, are the underlying assumptions required by many pairwis…
Learning-To-RankPosition