paper-with-me

홈 › Papers

No-Regret and Incentive-Compatible Online Learning

2020-02-20 · ICML 2020 1 · Rupert Freeman, David M. Pennock, Chara Podimata, Jennifer Wortman Vaughan

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold. First, we want the learning algorithm to be no-regret with respect to the best fixed expert in hindsight. Second, we want incentive compatibility, a guarantee that each expert's best strategy is to report his true beliefs about the realization of each event. To achieve this goal, we build on the literature on wagering mechanisms, a type of multi-agent scoring rule. We provide algorithms that achieve no regret and incentive compatibility for myopic experts for both the full and partial information settings. In experiments on datasets from FiveThirtyEight, our algorithms have regret comparable to classic no-regret algorithms, which are not incentive-compatible. Finally, we identify an incentive-compatible algorithm for forward-looking strategic agents that exhibits diminishing regret in practice.

📄 PDF Abstract BibTeX arXiv:2002.08837

Code (1)

charapod/noregr-and-ic 공식 구현

Tasks

scoring rule

Similar Papers 제목 키워드 기반

Incentive-compatible Bandits: Importance Weighting No More

2024-05-10 · Julian Zimmert, Teodor V. Marinov

We study the problem of incentive-compatible online learning with bandit feedback. In this class of problems, the experts are self-interested agents who might misrepresent their preferences with the goal of being selecte…

Online Learning for Measuring Incentive Compatibility in Ad Auctions

2019-01-21 · Zhe Feng, Okke Schrijvers, Eric Sodomka

In this paper we investigate the problem of measuring end-to-end Incentive Compatibility (IC) regret given black-box access to an auction mechanism. Our goal is to 1) compute an estimate for IC regret in an auction, 2) p…

Dynamic Online Recommendation for Two-Sided Market with Bayesian Incentive Compatibility

2024-06-04 · Yuantong Li, Guang Cheng, Xiaowu Dai

Recommender systems play a crucial role in internet economies by connecting users with relevant products or services. However, designing effective recommender systems faces two key challenges: (1) the exploration-exploit…

Recommendation Systems

Nash Incentive-compatible Online Mechanism Learning via Weakly Differentially Private Online Learning

2024-07-06 · Joon Suk Huh, Kirthevasan Kandasamy

We study a multi-round mechanism design problem, where we interact with a set of agents over a sequence of rounds. We wish to design an incentive-compatible (IC) online learning scheme to maximize an application-specific…

No-Regret Online Prediction with Strategic Experts

2023-05-24 · NeurIPS 2023 11

We study a generalization of the online binary prediction with expert advice framework where at each round, the learner is allowed to pick $m\geq 1$ experts from a pool of $K$ experts and the overall utility is a modular…

Prediction