paper-with-me

Papers

Exploiting Transitivity for Top-k Selection with Score-Based Dueling Bandits

2020-12-31 · Matthew Groves, Juergen Branke

We consider the problem of top-k subset selection in Dueling Bandit problems with score information. Real-world pairwise ranking problems often exhibit a high degree of transitivity and prior work has suggested sampling methods that exploit such transitivity through the use of parametric preference models like the Bradley-Terry-Luce (BTL) and Thurstone models. To date, this work has focused on cases where sample outcomes are win/loss binary responses. We extend this to selection problems where sampling results contain quantitative information by proposing a Thurstonian style model and adapting the Pairwise Optimal Computing Budget Allocation for subset selection (POCBAm) sampling method to exploit this model for efficient sample selection. We compare the empirical performance against standard POCBAm and other competing algorithms.

📄 PDF Abstract BibTeX arXiv:2012.15637

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Identifying Copeland Winners in Dueling Bandits with Indifferences

2023-10-01 · Viktor Bengs, Björn Haddenhorst, Eyke Hüllermeier

We consider the task of identifying the Copeland winner(s) in a dueling bandits problem with ternary feedback. This is an underexplored but practically relevant variant of the conventional dueling bandits problem, in whi…

Stochastic Contextual Dueling Bandits under Linear Stochastic Transitivity Models

2022-02-09 · Viktor Bengs, Aadirupa Saha, Eyke Hüllermeier

We consider the regret minimization task in a dueling bandits problem with context information. In every round of the sequential decision problem, the learner makes a context-dependent selection of two choice alternative…

KLUCB Approach to Copeland Bandits

2019-02-07 · Nischal Agrawal, Prasanna Chaporkar

Multi-armed bandit(MAB) problem is a reinforcement learning framework where an agent tries to maximise her profit by proper selection of actions through absolute feedback for each action. The dueling bandits problem is a…

Information RetrievalReinforcement LearningRetrievalThompson Sampling

Batched Dueling Bandits

2022-02-22 · Arpit Agarwal, Rohan Ghuge, Viswanath Nagarajan

The $K$-armed dueling bandit problem, where the feedback is in the form of noisy pairwise comparisons, has been widely studied. Previous works have only focused on the sequential setting where the policy adapts after eve…

Recommendation Systems

Adversarial Dueling Bandits

2020-10-27 · Aadirupa Saha, Tomer Koren, Yishay Mansour

We introduce the problem of regret minimization in Adversarial Dueling Bandits. As in classic Dueling Bandits, the learner has to repeatedly choose a pair of items and observe only a relative binary `win-loss' feedback f…