paper-with-me

Papers

Optimizing Group-Fair Plackett-Luce Ranking Models for Relevance and Ex-Post Fairness

2023-08-25 · Sruthi Gorantla, Eshaan Bhansali, Amit Deshpande, Anand Louis

In learning-to-rank (LTR), optimizing only the relevance (or the expected ranking utility) can cause representational harm to certain categories of items. Moreover, if there is implicit bias in the relevance scores, LTR models may fail to optimize for true relevance. Previous works have proposed efficient algorithms to train stochastic ranking models that achieve fairness of exposure to the groups ex-ante (or, in expectation), which may not guarantee representation fairness to the groups ex-post, that is, after realizing a ranking from the stochastic ranking model. Typically, ex-post fairness is achieved by post-processing, but previous work does not train stochastic ranking models that are aware of this post-processing. In this paper, we propose a novel objective that maximizes expected relevance only over those rankings that satisfy given representation constraints to ensure ex-post fairness. Building upon recent work on an efficient sampler for ex-post group-fair rankings, we propose a group-fair Plackett-Luce model and show that it can be efficiently optimized for our objective in the LTR framework. Experiments on three real-world datasets show that our group-fair algorithm guarantees fairness alongside usually having better relevance compared to the LTR baselines. In addition, our algorithm also achieves better relevance than post-processing baselines, which also ensures ex-post fairness. Further, when implicit bias is injected into the training data, our algorithm typically outperforms existing LTR baselines in relevance.

📄 PDF Abstract BibTeX arXiv:2308.13242

Code (1)

sruthigorantla/group-fair-pl 공식 구현

Tasks

FairnessLearning-To-Rank

Methods 이 논문이 사용한 방법론

fail 설명 없음
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Computationally Efficient Optimization of Plackett-Luce Ranking Models for Relevance and Fairness

2021-05-03 · Harrie Oosterhuis

Recent work has proposed stochastic Plackett-Luce (PL) ranking models as a robust choice for optimizing relevance and fairness metrics. Unlike their deterministic counterparts that require heuristic optimization algorith…

Fairness

Hierarchical Partial-Order Models for Ranking

2026-06-23 · Dongqing Li, Geoff K. Nicholls, Jeong Eun Lee, Chuxuan 외 arxiv

Rank aggregation combines information from ordered lists ranking items by preference. Classical parametric models for such data, including the Mallows and Plackett-Luce models, assume the orders concentrate around one or…

Bayesian Inference

DATELINE: Deep Plackett-Luce Model with Uncertainty Measurements

2018-12-14 · Bo Han

The aggregation of k-ary preferences is a historical and important problem, since it has many real-world applications, such as peer grading, presidential elections and restaurant ranking. Meanwhile, variants of Plackett-…

Online Rank Elicitation for Plackett-Luce: A Dueling Bandits Approach

2015-12-01 · NeurIPS 2015 12 · Balázs Szörényi, Róbert Busa-Fekete, Adil Paul, Eyke Hüllermeier

We study the problem of online rank elicitation, assuming that rankings of a set of alternatives obey the Plackett-Luce distribution. Following the setting of the dueling bandits problem, the learner is allowed to query …

Learning Mixtures of Plackett-Luce Models from Structured Partial Orders

2019-10-25 · NeurIPS 2019 12 · Zhibing Zhao, Lirong Xia

Mixtures of ranking models have been widely used for heterogeneous preferences. However, learning a mixture model is highly nontrivial, especially when the dataset consists of partial orders. In such cases, the parameter…

2kComputational Efficiency