paper-with-me

Papers

Spectral Ranking Inferences based on General Multiway Comparisons

2023-08-05 · Jianqing Fan, Zhipeng Lou, Weichen Wang, Mengxin Yu

This paper studies the performance of the spectral method in the estimation and uncertainty quantification of the unobserved preference scores of compared entities in a general and more realistic setup. Specifically, the comparison graph consists of hyper-edges of possible heterogeneous sizes, and the number of comparisons can be as low as one for a given hyper-edge. Such a setting is pervasive in real applications, circumventing the need to specify the graph randomness and the restrictive homogeneous sampling assumption imposed in the commonly used Bradley-Terry-Luce (BTL) or Plackett-Luce (PL) models. Furthermore, in scenarios where the BTL or PL models are appropriate, we unravel the relationship between the spectral estimator and the Maximum Likelihood Estimator (MLE). We discover that a two-step spectral method, where we apply the optimal weighting estimated from the equal weighting vanilla spectral method, can achieve the same asymptotic efficiency as the MLE. Given the asymptotic distributions of the estimated preference scores, we also introduce a comprehensive framework to carry out both one-sample and two-sample ranking inferences, applicable to both fixed and random graph settings. It is noteworthy that this is the first time effective two-sample rank testing methods have been proposed. Finally, we substantiate our findings via comprehensive numerical simulations and subsequently apply our developed methodologies to perform statistical inferences for statistical journals and movie rankings.

📄 PDF Abstract BibTeX arXiv:2308.02918

Code (0)

등록된 구현이 없습니다.

Tasks

Uncertainty Quantification

Similar Papers 제목 키워드 기반

Accelerated Spectral Ranking

2018-07-01 · ICML 2018 7 · Arpit Agarwal, Prathamesh Patil, Shivani Agarwal

The problem of rank aggregation from pairwise and multiway comparisons has a wide range of implications, ranging from recommendation systems to sports rankings to social choice. Some of the most popular algorithms f…

Recommendation Systems

Ranking Inferences Based on the Top Choice of Multiway Comparisons

2022-11-22 · Jianqing Fan, Zhipeng Lou, Weichen Wang, Mengxin Yu

This paper considers ranking inference of $n$ items based on the observed data on the top choice among $M$ randomly selected items at each trial. This is a useful modification of the Plackett-Luce model for $M$-way ranki…

valid

SerialRank: Spectral Ranking using Seriation

2014-12-01 · NeurIPS 2014 12 · Fajwel Fogel, Alexandre d'Aspremont, Milan Vojnovic

We describe a seriation algorithm for ranking a set of n items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compare similarly with all others. It does …

Spectral Ranking using Seriation

2014-06-20 · Fajwel Fogel, Alexandre d'Aspremont, Milan Vojnovic

We describe a seriation algorithm for ranking a set of items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compare similarly with all others. It does so…

Are Optimal Algorithms Still Optimal? Rethinking Sorting in LLM-Based Pairwise Ranking with Batching and Caching

2025-05-30 · Juan Wisznia, Cecilia Bolaños, Juan Tollo, Giovanni Marraffini 외

We introduce a novel framework for analyzing sorting algorithms in pairwise ranking prompting (PRP), re-centering the cost model around LLM inferences rather than traditional pairwise comparisons. While classical metrics…