DEAR: Deep Reinforcement Learning for Online Advertising Impression in Recommender Systems

2019-09-09 · Xiangyu Zhao, Changsheng Gu, Haoshenglun Zhang, Xiwang Yang, Xiaobing Liu, Jiliang Tang, Hui Liu

With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in utilizing RL for online advertising in recommendation platforms (e.g., e-commerce and news feed sites). However, most RL-based advertising algorithms focus on optimizing ads' revenue while ignoring the possible negative influence of ads on user experience of recommended items (products, articles and videos). Developing an optimal advertising algorithm in recommendations faces immense challenges because interpolating ads improperly or too frequently may decrease user experience, while interpolating fewer ads will reduce the advertising revenue. Thus, in this paper, we propose a novel advertising strategy for the rec/ads trade-off. To be specific, we develop an RL-based framework that can continuously update its advertising strategies and maximize reward in the long run. Given a recommendation list, we design a novel Deep Q-network architecture that can determine three internally related tasks jointly, i.e., (i) whether to interpolate an ad or not in the recommendation list, and if yes, (ii) the optimal ad and (iii) the optimal location to interpolate. The experimental results based on real-world data demonstrate the effectiveness of the proposed framework.

📄 PDF Abstract BibTeX arXiv:1909.03602

Code (0)

등록된 구현이 없습니다.

Tasks

ArticlesDeep Reinforcement LearningRecommendation Systems reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Multi-Agent Reinforcement Learning Method for Impression Allocation in Online Display Advertising

2018-09-10 · Di Wu, Cheng Chen, Xun Yang, Xiujun Chen 외

In online display advertising, guaranteed contracts and real-time bidding (RTB) are two major ways to sell impressions for a publisher. Despite the increasing popularity of RTB, there is still half of online display adve…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Optimizing Long-term Value for Auction-Based Recommender Systems via On-Policy Reinforcement Learning

2023-05-23 · Ruiyang Xu, Jalaj Bhandari, Dmytro Korenkevych, Fan Liu 외

Auction-based recommender systems are prevalent in online advertising platforms, but they are typically optimized to allocate recommendation slots based on immediate expected return metrics, neglecting the downstream eff…

Recommendation Systems reinforcement-learning Reinforcement Learning

RLTP: Reinforcement Learning to Pace for Delayed Impression Modeling in Preloaded Ads

2023-02-06 · Penghui Wei, Yongqiang Chen, Shaoguo Liu, Liang Wang 외

To increase brand awareness, many advertisers conclude contracts with advertising platforms to purchase traffic and then deliver advertisements to target audiences. In a whole delivery period, advertisers usually desire …

reinforcement-learning Reinforcement Learning (RL)

Impression Allocation and Policy Search in Display Advertising

2022-03-11 · Di wu, Cheng Chen, Xiujun Chen, Junwei Pan 외

In online display advertising, guaranteed contracts and real-time bidding (RTB) are two major ways to sell impressions for a publisher. For large publishers, simultaneously selling impressions through both guaranteed con…

Multi-agent Reinforcement Learning

Deep Reinforcement Learning-Based Product Recommender for Online Advertising

2021-01-30 · Milad Vaali Esfahaani, Yanbo Xue, Peyman Setoodeh

In online advertising, recommender systems try to propose items from a list of products to potential customers according to their interests. Such systems have been increasingly deployed in E-commerce due to the rapid gro…

Deep Reinforcement Learning Recommendation Systems reinforcement-learning Reinforcement Learning+2