paper-with-me

Papers

Computationally Efficient Optimization of Plackett-Luce Ranking Models for Relevance and Fairness

2021-05-03 · Harrie Oosterhuis

Recent work has proposed stochastic Plackett-Luce (PL) ranking models as a robust choice for optimizing relevance and fairness metrics. Unlike their deterministic counterparts that require heuristic optimization algorithms, PL models are fully differentiable. Theoretically, they can be used to optimize ranking metrics via stochastic gradient descent. However, in practice, the computation of the gradient is infeasible because it requires one to iterate over all possible permutations of items. Consequently, actual applications rely on approximating the gradient via sampling techniques. In this paper, we introduce a novel algorithm: PL-Rank, that estimates the gradient of a PL ranking model w.r.t. both relevance and fairness metrics. Unlike existing approaches that are based on policy gradients, PL-Rank makes use of the specific structure of PL models and ranking metrics. Our experimental analysis shows that PL-Rank has a greater sample-efficiency and is computationally less costly than existing policy gradients, resulting in faster convergence at higher performance. PL-Rank further enables the industry to apply PL models for more relevant and fairer real-world ranking systems.

📄 PDF Abstract BibTeX arXiv:2105.00855

Code (1)

HarrieO/2021-SIGIR-plackett-luce 공식 구현 tf

Tasks

Fairness

Similar Papers 제목 키워드 기반

Optimizing Group-Fair Plackett-Luce Ranking Models for Relevance and Ex-Post Fairness

2023-08-25 · Sruthi Gorantla, Eshaan Bhansali, Amit Deshpande, Anand Louis

In learning-to-rank (LTR), optimizing only the relevance (or the expected ranking utility) can cause representational harm to certain categories of items. Moreover, if there is implicit bias in the relevance scores, LTR …

FairnessLearning-To-Rank

DATELINE: Deep Plackett-Luce Model with Uncertainty Measurements

2018-12-14 · Bo Han

The aggregation of k-ary preferences is a historical and important problem, since it has many real-world applications, such as peer grading, presidential elections and restaurant ranking. Meanwhile, variants of Plackett-…

Online Rank Elicitation for Plackett-Luce: A Dueling Bandits Approach

2015-12-01 · NeurIPS 2015 12 · Balázs Szörényi, Róbert Busa-Fekete, Adil Paul, Eyke Hüllermeier

We study the problem of online rank elicitation, assuming that rankings of a set of alternatives obey the Plackett-Luce distribution. Following the setting of the dueling bandits problem, the learner is allowed to query …

Choosing to Rank

2018-09-13 · Stephen Ragain, Johan Ugander

Ranking data arises in a wide variety of application areas but remains difficult to model, learn from, and predict. Datasets often exhibit multimodality, intransitivity, or incomplete rankings---particularly when generat…

Car Racing

Learning-to-Rank at the Speed of Sampling: Plackett-Luce Gradient Estimation With Minimal Computational Complexity

2022-04-22 · Harrie Oosterhuis

Plackett-Luce gradient estimation enables the optimization of stochastic ranking models within feasible time constraints through sampling techniques. Unfortunately, the computational complexity of existing methods does n…

Learning-To-Rank