Multi-objective Optimization of Notifications Using Offline Reinforcement Learning

2022-07-07 · Prakruthi Prabhakar, Yiping Yuan, Guangyu Yang, Wensheng Sun, Ajith Muralidharan

Mobile notification systems play a major role in a variety of applications to communicate, send alerts and reminders to the users to inform them about news, events or messages. In this paper, we formulate the near-real-time notification decision problem as a Markov Decision Process where we optimize for multiple objectives in the rewards. We propose an end-to-end offline reinforcement learning framework to optimize sequential notification decisions. We address the challenge of offline learning using a Double Deep Q-network method based on Conservative Q-learning that mitigates the distributional shift problem and Q-value overestimation. We illustrate our fully-deployed system and demonstrate the performance and benefits of the proposed approach through both offline and online experiments.

📄 PDF Abstract BibTeX arXiv:2207.03029

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Offline Reinforcement Learning for Mobile Notifications

2022-02-04 · Yiping Yuan, Ajith Muralidharan, Preetam Nandy, Miao Cheng 외

Mobile notification systems have taken a major role in driving and maintaining user engagement for online platforms. They are interesting recommender systems to machine learning practitioners with more sequential and lon…

Attribute Recommendation Systems reinforcement-learning Reinforcement Learning+1

Generative Sequential Notification Optimization via Multi-Objective Decision Transformers

2025-09-02 · Borja Ocejo, Ruofan Wang, Ke Liu, Rohit K. Patra 외 arxiv

Notifications are an important communication channel for delivering timely and relevant information. Optimizing their delivery involves addressing complex sequential decision-making challenges under constraints such as m…

Reinforcement Learning

Should I send this notification? Optimizing push notifications decision making by modeling the future

2022-02-17 · Conor O'Brien, Huasen Wu, Shaodan Zhai, Dalin Guo 외

Most recommender systems are myopic, that is they optimize based on the immediate response of the user. This may be misaligned with the true objective, such as creating long term user satisfaction. In this work we focus …

Decision Making Model-based Reinforcement Learning Recommendation Systems Reinforcement Learning (RL)

A Sleeping, Recovering Bandit Algorithm for Optimizing Recurring Notifications

2020-08-23 · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining 2020 8 · Kevin P. Yancey, Burr Settles

Many online and mobile applications rely on daily emails and push notifications to increase and maintain user engagement. The multi-armed bandit approach provides a useful framework for optimizing the content of these no…

Multi-Armed Bandits

Pareto-Optimal Offline Reinforcement Learning via Smooth Tchebysheff Scalarization

2026-04-14 · Aadyot Bhatnagar, Peter Mørch Groth, Ali Madani arxiv

Large language models can be aligned with human preferences through offline reinforcement learning (RL) on small labeled datasets. While single-objective alignment is well-studied, many real-world applications demand the…

Reinforcement Learning Offline RL