Incentive-Theoretic Bayesian Inference for Collaborative Science

2023-07-07 · Stephen Bates, Michael I. Jordan, Michael Sklar, Jake A. Soloff

Contemporary scientific research is a distributed, collaborative endeavor, carried out by teams of researchers, regulatory institutions, funding agencies, commercial partners, and scientific bodies, all interacting with each other and facing different incentives. To maintain scientific rigor, statistical methods should acknowledge this state of affairs. To this end, we study hypothesis testing when there is an agent (e.g., a researcher or a pharmaceutical company) with a private prior about an unknown parameter and a principal (e.g., a policymaker or regulator) who wishes to make decisions based on the parameter value. The agent chooses whether to run a statistical trial based on their private prior and then the result of the trial is used by the principal to reach a decision. We show how the principal can conduct statistical inference that leverages the information that is revealed by an agent's strategic behavior -- their choice to run a trial or not. In particular, we show how the principal can design a policy to elucidate partial information about the agent's private prior beliefs and use this to control the posterior probability of the null. One implication is a simple guideline for the choice of significance threshold in clinical trials: the type-I error level should be set to be strictly less than the cost of the trial divided by the firm's profit if the trial is successful.

📄 PDF Abstract BibTeX arXiv:2307.03748

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Bayesian Reinforcement Learning: A Survey

2016-09-14 · Mohammad Ghavamzadeh, Shie Mannor, Joelle Pineau, Aviv Tamar

Bayesian methods for machine learning have been widely investigated, yielding principled methods for incorporating prior information into inference algorithms. In this survey, we provide an in-depth review of the role of…

Bayesian Inference reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Collaborating in Multi-Armed Bandits with Strategic Agents

2026-05-13 · Idan Barnea, Ofir Schlisselberg, Yishay Mansour arxiv

We study collaborative learning in multi-agent Bayesian bandit problems, where strategic agents collectively solve the same bandit instance. While multiple agents can accelerate learning by sharing information, strategic…

Multi-Armed Bandits

Incentives in Private Collaborative Machine Learning

2024-04-02 · NeurIPS 2023 11 · Rachael Hwee Ling Sim, Yehong Zhang, Trong Nghia Hoang, Xinyi Xu 외

Collaborative machine learning involves training models on data from multiple parties but must incentivize their participation. Existing data valuation methods fairly value and reward each party based on shared data or m…

Data Valuation Fairness

Inference Aided Reinforcement Learning for Incentive Mechanism Design in Crowdsourcing

2018-06-01 · NeurIPS 2018 12 · Zehong Hu, Yitao Liang, Yang Liu, Jie Zhang

Incentive mechanisms for crowdsourcing are designed to incentivize financially self-interested workers to generate and report high-quality labels. Existing mechanisms are often developed as one-shot static solutions, ass…

Bayesian Inference reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Dynamic Online Recommendation for Two-Sided Market with Bayesian Incentive Compatibility

2024-06-04 · Yuantong Li, Guang Cheng, Xiaowu Dai

Recommender systems play a crucial role in internet economies by connecting users with relevant products or services. However, designing effective recommender systems faces two key challenges: (1) the exploration-exploit…

Recommendation Systems