BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotion

2022-07-16 · Fanglin Chen, Xiao Liu, Bo Tang, Feiyu Xiong, Serim Hwang, Guomian Zhuang

We utilize an offline reinforcement learning (RL) model for sequential targeted promotion in the presence of budget constraints in a real-world business environment. In our application, the mobile app aims to boost customer retention by sending cash bonuses to customers and control the costs of such cash bonuses during each time period. To achieve the multi-task goal, we propose the Budget Constrained Reinforcement Learning for Sequential Promotion (BCRLSP) framework to determine the value of cash bonuses to be sent to users. We first find out the target policy and the associated Q-values that maximizes the user retention rate using an RL model. A linear programming (LP) model is then added to satisfy the constraints of promotion costs. We solve the LP problem by maximizing the Q-values of actions learned from the RL model given the budget constraints. During deployment, we combine the offline RL model with the LP model to generate a robust policy under the budget constraints. Using both online and offline experiments, we demonstrate the efficacy of our approach by showing that BCRLSP achieves a higher long-term customer retention rate and a lower cost than various baselines. Taking advantage of the near real-time cost control method, the proposed framework can easily adapt to data with a noisy behavioral policy and/or meet flexible budget constraints.

📄 PDF Abstract BibTeX arXiv:2207.07790

Code (0)

등록된 구현이 없습니다.

Tasks

Offline RL reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning to Allocate Incentives for Incentivized Advertising via Offline Model-Based Reinforcement Learning

2026-08-28 · Zilin Zhao, Han Yang, Tianpei Yang, Fangsheng Huang 외 arxiv

Complete your ad view and grab a 5-cent bonus! In incentivized advertising, a platform promises users a bonus before observing downstream ad revenue, encouraging them to click and complete ads. It must balance the incent…

Reinforcement Learning Causal Inference Offline RL

Offline-to-Online Multi-Agent Reinforcement Learning with Offline Value Function Memory and Sequential Exploration

2024-10-25 · Hai Zhong, Xun Wang, Zhuoran Li, Longbo Huang

Offline-to-Online Reinforcement Learning has emerged as a powerful paradigm, leveraging offline data for initialization and online fine-tuning to enhance both sample efficiency and performance. However, most existing res…

Efficient Exploration Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+3

Offline Reinforcement Learning for Mobile Notifications

2022-02-04 · Yiping Yuan, Ajith Muralidharan, Preetam Nandy, Miao Cheng 외

Mobile notification systems have taken a major role in driving and maintaining user engagement for online platforms. They are interesting recommender systems to machine learning practitioners with more sequential and lon…

Attribute Recommendation Systems reinforcement-learning Reinforcement Learning+1

IPD: Boosting Sequential Policy with Imaginary Planning Distillation in Offline Reinforcement Learning

2026-03-04 · Yihao Qin, Yuanfei Wang, Hang Zhou, Peiran Liu 외 arxiv

Decision transformer based sequential policies have emerged as a powerful paradigm in offline reinforcement learning (RL), yet their efficacy remains constrained by the quality of static datasets and inherent architectur…

Reinforcement Learning Offline RL

Multi-objective Optimization of Notifications Using Offline Reinforcement Learning

2022-07-07 · Prakruthi Prabhakar, Yiping Yuan, Guangyu Yang, Wensheng Sun 외

Mobile notification systems play a major role in a variety of applications to communicate, send alerts and reminders to the users to inform them about news, events or messages. In this paper, we formulate the near-real-t…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)