paper-with-me

홈 › Papers

Scalable Neural Contextual Bandit for Recommender Systems

2023-06-26 · Zheqing Zhu, Benjamin Van Roy

High-quality recommender systems ought to deliver both innovative and relevant content through effective and exploratory interactions with users. Yet, supervised learning-based neural networks, which form the backbone of many existing recommender systems, only leverage recognized user interests, falling short when it comes to efficiently uncovering unknown user preferences. While there has been some progress with neural contextual bandit algorithms towards enabling online exploration through neural networks, their onerous computational demands hinder widespread adoption in real-world recommender systems. In this work, we propose a scalable sample-efficient neural contextual bandit algorithm for recommender systems. To do this, we design an epistemic neural network architecture, Epistemic Neural Recommendation (ENR), that enables Thompson sampling at a large scale. In two distinct large-scale experiments with real-world tasks, ENR significantly boosts click-through rates and user ratings by at least 9% and 6% respectively compared to state-of-the-art neural contextual bandit algorithms. Furthermore, it achieves equivalent performance with at least 29% fewer user interactions compared to the best-performing baseline algorithm. Remarkably, while accomplishing these improvements, ENR demands orders of magnitude fewer computational resources than neural contextual bandit baseline algorithms.

📄 PDF Abstract BibTeX arXiv:2306.14834

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation SystemsThompson Sampling

Similar Papers 제목 키워드 기반

Neural Contextual Bandits for Personalized Recommendation

2023-12-21 · Yikun Ban, Yunzhe Qi, Jingrui He

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric r…

Multi-Armed BanditsRecommendation Systems

Conversational Contextual Bandit: Algorithm and Application

2019-06-04 · Xiaoying Zhang, Hong Xie, Hang Li, John C. S. Lui

Contextual bandit algorithms provide principled online learning solutions to balance the exploitation-exploration trade-off in various applications such as recommender systems. However, the learning speed of the traditio…

ArticlesNews RecommendationRecommendation Systems

Bandits Warm-up Cold Recommender Systems

2014-07-10 · Jérémie Mary, Romaric Gaudel, Preux Philippe

We address the cold start problem in recommendation systems assuming no contextual information is available neither about users, nor items. We consider the case in which we only have access to a set of ratings of items b…

Multi-Armed BanditsRecommendation Systems

Offline Contextual Multi-armed Bandits for Mobile Health Interventions: A Case Study on Emotion Regulation

2020-08-21 · Mawulolo K. Ameko, Miranda L. Beltzer, Lihua Cai, Mehdi Boukhechba 외

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentat…

ManagementMulti-Armed BanditsRecommendation Systems

Tight Regret Bounds for Infinite-armed Linear Contextual Bandits

2019-05-04 · Yingkai Li, Yining Wang, Xi Chen, Yuan Zhou

Linear contextual bandit is an important class of sequential decision making problems with a wide range of applications to recommender systems, online advertising, healthcare, and many other machine learning related task…

Decision MakingMulti-Armed BanditsRecommendation SystemsSequential Decision Making