paper-with-me

홈 › Papers

Design-Based Bandits Under Network Interference: Trade-Off Between Regret and Statistical Inference

2025-10-09 · Zichen Wang, Haoyang Hong, Chuanhao Li, Haoxuan Li, Zhiheng Zhang, Huazheng Wang arxiv

In multi-armed bandits with network interference (MABNI), the action taken by one node can influence the rewards of others, creating complex interdependence. While existing research on MABNI largely concentrates on minimizing regret, it often overlooks the crucial concern that an excessive emphasis on the optimal arm can undermine the inference accuracy for sub-optimal arms. Although initial efforts have been made to address this trade-off in single-unit scenarios, these challenges have become more pronounced in the context of MABNI. In this paper, we establish, for the first time, a theoretical Pareto frontier characterizing the trade-off between regret minimization and inference accuracy in adversarial (design-based) MABNI. We further introduce an anytime-valid asymptotic confidence sequence along with a corresponding algorithm, $\texttt{EXP3-N-CS}$, specifically designed to balance the trade-off between regret minimization and inference accuracy in this setting.

📄 PDF Abstract BibTeX arXiv:2510.07646

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Armed Bandits

Similar Papers 제목 키워드 기반

Linear Contextual Bandits with Interference

2024-09-24 · Yang Xu, Wenbin Lu, Rui Song

Interference, a key concept in causal inference, extends the reward modeling process by accounting for the impact of one unit's actions on the rewards of others. In contextual bandit (CB) settings, where multiple units a…

Causal InferenceDecision MakingMulti-Armed Bandits

Graph-Dependent Regret Bounds in Multi-Armed Bandits with Interference

2025-03-10 · Fateme Jamshidi, Mohammad ShahverdiKondori, Negar Kiyavash

Multi-armed bandits (MABs) are frequently used for online sequential decision-making in applications ranging from recommending personalized content to assigning treatments to patients. A recurring challenge in the applic…

Multi-Armed BanditsSequential Decision Making

Multi-Armed Bandits with Interference

2024-02-02 · Su Jia, Peter Frazier, Nathan Kallus

Experimentation with interference poses a significant challenge in contemporary online platforms. Prior research on experimentation with interference has concentrated on the final output of a policy. The cumulative perfo…

Multi-Armed Bandits

Communication-Efficient Collaborative Regret Minimization in Multi-Armed Bandits

2023-01-26 · Nikolai Karpov, Qin Zhang

In this paper, we study the collaborative learning model, which concerns the tradeoff between parallelism and communication overhead in multi-agent multi-armed bandits. For regret minimization in multi-armed bandits, we …

Multi-agent Reinforcement LearningMulti-Armed Banditsreinforcement-learningReinforcement Learning (RL)

Estimating Causal Effects in Networks with Cluster-Based Bandits

2025-05-07 · Ahmed Sayeed Faruk, Jason Sulskis, Elena Zheleva

The gold standard for estimating causal effects is randomized controlled trial (RCT) or A/B testing where a random group of individuals from a population of interest are given treatment and the outcome is compared to a r…