paper-with-me

홈 › Papers

AutoML for Contextual Bandits

2019-09-07 · Praneet Dutta, Joe Cheuk, Jonathan S Kim, Massimo Mascaro

Contextual Bandits is one of the widely popular techniques used in applications such as personalization, recommendation systems, mobile health, causal marketing etc . As a dynamic approach, it can be more efficient than standard A/B testing in minimizing regret. We propose an end to end automated meta-learning pipeline to approximate the optimal Q function for contextual bandits problems. We see that our model is able to perform much better than random exploration, being more regret efficient and able to converge with a limited number of samples, while remaining very general and easy to use due to the meta-learning approach. We used a linearly annealed e-greedy exploration policy to define the exploration vs exploitation schedule. We tested the system on a synthetic environment to characterize it fully and we evaluated it on some open source datasets to benchmark against prior work. We see that our model outperforms or performs comparatively to other models while requiring no tuning nor feature engineering.

📄 PDF Abstract BibTeX arXiv:1909.03212

Code (0)

등록된 구현이 없습니다.

Tasks

AutoMLFeature EngineeringMarketingMeta-LearningMulti-Armed BanditsRecommendation Systems

Similar Papers 제목 키워드 기반

Neural Contextual Bandits for Personalized Recommendation

2023-12-21 · Yikun Ban, Yunzhe Qi, Jingrui He

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric r…

Multi-Armed BanditsRecommendation Systems

Put CASH on Bandits: A Max K-Armed Problem for Automated Machine Learning

2025-05-08 · Amir Rezaei Balef, Claire Vernade, Katharina Eggensperger

The Combined Algorithm Selection and Hyperparameter optimization (CASH) is a challenging resource allocation problem in the field of AutoML. We propose MaxUCB, a max $k$-armed bandit method to trade off exploring differe…

AutoMLHyperparameter Optimization

Resourceful Contextual Bandits

2014-02-27 · Ashwinkumar Badanidiyuru, John Langford, Aleksandrs Slivkins

We study contextual bandits with ancillary constraints on resources, which are common in real-world applications such as choosing ads or dynamic pricing of items. We design the first algorithm for solving these problems …

Multi-Armed Bandits

A conversion theorem and minimax optimality for continuum contextual bandits

2024-06-09 · Arya Akhavan, Karim Lounici, Massimiliano Pontil, Alexandre B. Tsybakov

We study the contextual continuum bandits problem, where the learner sequentially receives a side information vector and has to choose an action in a convex set, minimizing a function associated with the context. The goa…

Multi-Armed Bandits

Estimation Considerations in Contextual Bandits

2017-11-19 · Maria Dimakopoulou, Zhengyuan Zhou, Susan Athey, Guido Imbens

Contextual bandit algorithms are sensitive to the estimation method of the outcome model as well as the exploration method used, particularly in the presence of rich heterogeneity or complex outcome models, which can lea…

Causal InferenceEconometricsMulti-Armed Bandits