paper-with-me

홈 › Papers

On ranking via sorting by estimated expected utility

2020-12-01 · NeurIPS 2020 12 · Clement Calauzenes, Nicolas Usunier

Ranking and selection tasks appear in different contexts with specific desiderata, such as the maximizaton of average relevance on the top of the list, the requirement of diverse rankings, or, relatedly, the focus on providing at least one relevant items to as many users as possible. This paper addresses the question of which of these tasks are asymptotically solved by sorting by decreasing order of expected utility, for some suitable notion of utility, or, equivalently, \emph{when is square loss regression consistent for ranking \emph{via} score-and-sort?}. We provide an answer to this question in the form of a structural characterization of ranking losses for which a suitable regression is consistent. This result has two fundamental corollaries. First, whenever there exists a consistent approach based on convex risk minimization, there also is a consistent approach based on regression. Second, when regression is not consistent, there are data distributions for which consistent surrogate approaches necessarily have non-trivial local minima, and optimal scoring function are necessarily discontinuous, even when the underlying data distribution is regular. In addition to providing a better understanding of surrogate approaches for ranking, these results illustrate the intrinsic difficulty of solving general ranking problems with the score-and-sort approach.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Marginal-Certainty-aware Fair Ranking Algorithm

2022-12-18 · Tao Yang, Zhichao Xu, Zhenduo Wang, Anh Tran 외

Ranking systems are ubiquitous in modern Internet services, including online marketplaces, social media, and search engines. Traditionally, ranking systems only focus on how to get better relevance estimation. When relev…

Fairness

Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation

2024-06-17 · Boxuan Lyu, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu Okumura

Maximum a posteriori decoding, a commonly used method for neural machine translation (NMT), aims to maximize the estimated posterior probability. However, high estimated probability does not always lead to high translati…

Machine TranslationNMTRerankingTranslation

The Impact of Group Membership Bias on the Quality and Fairness of Exposure in Ranking

2023-08-05 · Ali Vardasbi, Maarten de Rijke, Fernando Diaz, Mostafa Dehghani

When learning to rank from user interactions, search and recommender systems must address biases in user behavior to provide a high-quality ranking. One type of bias that has recently been studied in the ranking literatu…

FairnessLearning-To-RankRecommendation Systems

Utility-Theoretic Ranking for Semi-Automated Text Classification

2015-03-02 · Giacomo Berardi, Andrea Esuli, Fabrizio Sebastiani

\emph{Semi-Automated Text Classification} (SATC) may be defined as the task of ranking a set $\mathcal{D}$ of automatically labelled textual documents in such a way that, if a human annotator validates (i.e., inspects an…

ClassificationGeneral Classificationtext-classificationText Classification

Let the Agent Steer: Closed-Loop Ranking Optimization via Influence Exchange

2026-03-29 · Yin Cheng, Liao Zhou, Xiyu Liang, Dihao Luo 외 arxiv

Recommendation ranking is fundamentally an influence allocation problem: a sorting formula distributes ranking influence among competing factors, and the business outcome depends on finding the optimal "exchange rates" a…