paper-with-me

홈 › Papers

Dueling Bandits with Team Comparisons

2021-07-06 · NeurIPS 2021 12 · Lee Cohen, Ulrike Schmidt-Kraepelin, Yishay Mansour

We introduce the dueling teams problem, a new online-learning setting in which the learner observes noisy comparisons of disjoint pairs of $k$-sized teams from a universe of $n$ players. The goal of the learner is to minimize the number of duels required to identify, with high probability, a Condorcet winning team, i.e., a team which wins against any other disjoint team (with probability at least $1/2$). Noisy comparisons are linked to a total order on the teams. We formalize our model by building upon the dueling bandits setting (Yue et al.2012) and provide several algorithms, both for stochastic and deterministic settings. For the stochastic setting, we provide a reduction to the classical dueling bandits setting, yielding an algorithm that identifies a Condorcet winning team within $\mathcal{O}((n + k \log (k)) \frac{\max(\log\log n, \log k)}{\Delta^2})$ duels, where $\Delta$ is a gap parameter. For deterministic feedback, we additionally present a gap-independent algorithm that identifies a Condorcet winning team within $\mathcal{O}(nk\log(k)+k^5)$ duels.

📄 PDF Abstract BibTeX arXiv:2107.02738

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Simple Algorithms for Dueling Bandits

2019-06-18 · Tyler Lekang, Andrew Lamperski

In this paper, we present simple algorithms for Dueling Bandits. We prove that the algorithms have regret bounds for time horizon T of order O(T^rho ) with 1/2 <= rho <= 3/4, which importantly do not depend on any prefer…

Multi-Dueling Bandits and Their Application to Online Ranker Evaluation

2016-08-22 · Brian Brost, Yevgeny Seldin, Ingemar J. Cox, Christina Lioma

New ranking algorithms are continually being developed and refined, necessitating the development of efficient methods for evaluating these rankers. Online ranker evaluation focuses on the challenge of efficiently determ…

Online Ranker Evaluation

Variance-Aware Regret Bounds for Stochastic Contextual Dueling Bandits

2023-10-02 · Qiwei Di, Tao Jin, Yue Wu, Heyang Zhao 외

Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and rec…

Computational EfficiencyDecision MakingInformation RetrievalRecommendation Systems

Multi-Player Approaches for Dueling Bandits

2024-05-25 · Or Raveh, Junya Honda, Masashi Sugiyama

Various approaches have emerged for multi-armed bandits in distributed systems. The multiplayer dueling bandit problem, common in scenarios with only preference-based information like human feedback, introduces challenge…

Multi-Armed Bandits

Online Rank Elicitation for Plackett-Luce: A Dueling Bandits Approach

2015-12-01 · NeurIPS 2015 12 · Balázs Szörényi, Róbert Busa-Fekete, Adil Paul, Eyke Hüllermeier

We study the problem of online rank elicitation, assuming that rankings of a set of alternatives obey the Plackett-Luce distribution. Following the setting of the dueling bandits problem, the learner is allowed to query …