paper-with-me

Papers

Multi-Task Learning for Contextual Bandits

2017-05-24 · NeurIPS 2017 12 · Aniket Anand Deshmukh, Urun Dogan, Clayton Scott

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad placement, and other applications. In this work, we propose a multi-task learning framework for contextual bandit problems. Like multi-task learning in the batch setting, the goal is to leverage similarities in contexts for different arms so as to improve the agent's ability to predict rewards from contexts. We propose an upper confidence bound-based multi-task learning algorithm for contextual bandits, establish a corresponding regret bound, and interpret this bound to quantify the advantages of learning in the presence of high task (arm) similarity. We also describe an effective scheme for estimating task similarity from data, and demonstrate our algorithm's performance on several data sets.

📄 PDF Abstract BibTeX arXiv:1705.08618

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Armed BanditsMulti-Task LearningNews Recommendation

Similar Papers 제목 키워드 기반

Deep Contextual Multi-armed Bandits

2018-07-25 · Mark Collier, Hector Urdiales Llorens

Contextual multi-armed bandit problems arise frequently in important industrial applications. Existing solutions model the context either linearly, which enables uncertainty driven (principled) exploration, or non-linear…

MarketingMulti-Armed BanditsThompson Sampling

Fast and Sample Efficient Multi-Task Representation Learning in Stochastic Contextual Bandits

2024-10-02 · Jiabin Lin, Shana Moothedath, Namrata Vaswani

We study how representation learning can improve the learning efficiency of contextual bandit problems. We study the setting where we play T contextual linear bandits with dimension d simultaneously, and these T bandit t…

Multi-Armed BanditsMulti-Task LearningRepresentation Learning

Estimation Considerations in Contextual Bandits

2017-11-19 · Maria Dimakopoulou, Zhengyuan Zhou, Susan Athey, Guido Imbens

Contextual bandit algorithms are sensitive to the estimation method of the outcome model as well as the exploration method used, particularly in the presence of rich heterogeneity or complex outcome models, which can lea…

Causal InferenceEconometricsMulti-Armed Bandits

Locally Differentially Private (Contextual) Bandits Learning

2020-06-01 · NeurIPS 2020 12 · Kai Zheng, Tianle Cai, Weiran Huang, Zhenguo Li 외

We study locally differentially private (LDP) bandits learning in this paper. First, we propose simple black-box reduction frameworks that can solve a large family of context-free bandits learning problems with LDP guara…

Multi-Armed BanditsPrivacy Preserving Deep Learning

Neural Contextual Bandits for Personalized Recommendation

2023-12-21 · Yikun Ban, Yunzhe Qi, Jingrui He

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric r…

Multi-Armed BanditsRecommendation Systems