paper-with-me

홈 › Papers

Eliminating Search Intent Bias in Learning to Rank

2020-02-08 · Yingcheng Sun, Richard Kolacinski, Kenneth Loparo

Click-through data has proven to be a valuable resource for improving search-ranking quality. Search engines can easily collect click data, but biases introduced in the data can make it difficult to use the data effectively. In order to measure the effects of biases, many click models have been proposed in the literature. However, none of the models can explain the observation that users with different search intent (e.g., informational, navigational, etc.) have different click behaviors. In this paper, we study how differences in user search intent can influence click activities and determined that there exists a bias between user search intent and the relevance of the document relevance. Based on this observation, we propose a search intent bias hypothesis that can be applied to most existing click models to improve their ability to learn unbiased relevance. Experimental results demonstrate that after adopting the search intent hypothesis, click models can better interpret user clicks and substantially improve retrieval performance.

📄 PDF Abstract BibTeX arXiv:2002.03203

Code (0)

등록된 구현이 없습니다.

Tasks

Learning-To-RankRetrieval

Similar Papers 제목 키워드 기반

Causal Disentanglement for Semantics-Aware Intent Learning in Recommendation

2022-02-05 · Xiangmeng Wang, Qian Li, Dianer Yu, Peng Cui 외

Traditional recommendation models trained on observational interaction data have generated large impacts in a wide range of applications, it faces bias problems that cover users' true intent and thus deteriorate the reco…

Disentanglement

Measurement and applications of position bias in a marketplace search engine

2022-06-23 · Richard Demsyn-Jones

Search engines intentionally influence user behavior by picking and ranking the list of results. Users engage with the highest results both because of their prominent placement and because they are typically the most rel…

Position

Calibration for Stratified Classification Models

2017-10-31 · Chandler Zuo

In classification problems, sampling bias between training data and testing data is critical to the ranking performance of classification scores. Such bias can be both unintentionally introduced by data collection and in…

ClassificationGeneral Classification

Multi-Feature Integration for Perception-Dependent Examination-Bias Estimation

2023-02-27 · Xiaoshu Chen, Xiangsheng Li, Kunliang Wei, Bin Hu 외

Eliminating examination bias accurately is pivotal to apply click-through data to train an unbiased ranking model. However, most examination-bias estimators are limited to the hypothesis of Position-Based Model (PBM), wh…

Detection of Groups with Biased Representation in Ranking

2022-12-30 · Jinyang Li, Yuval Moskovitch, H. V. Jagadish

Real-life tools for decision-making in many critical domains are based on ranking results. With the increasing awareness of algorithmic fairness, recent works have presented measures for fairness in ranking. Many of thos…

Decision MakingFairness