Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation
Reinforcement learning is well suited for optimizing policies of recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with the real environment, and thus are expensive in model learning. Offline evaluation methods, such as importance sampling, can alleviate such limitations, but usually request a large amount of logged data and do not work well when the action space is large. In this work, we propose a model-based reinforcement learning solution which models user-agent interaction for offline policy learning via a generative adversarial network. To reduce bias in the learned model and policy, we use a discriminator to evaluate the quality of generated data and scale the generated rewards. Our theoretical analysis and empirical evaluations demonstrate the effectiveness of our solution in learning policies from the offline and generated data.
Code (3)
Tasks
Generative Adversarial NetworkModel-based Reinforcement LearningRecommendation Systemsreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Generative Adversarial User Model for Reinforcement Learning Based Recommendation System
There are great interests as well as many challenges in applying reinforcement learning (RL) to recommendation systems. In this setting, an online user is the environment; neither the reward function nor the environment …
Generative Adversarial NetworkModel-based Reinforcement LearningRecommendation Systemsreinforcement-learning+2Online POI Recommendation: Learning Dynamic Geo-Human Interactions in Streams
In this paper, we focus on the problem of modeling dynamic geo-human interactions in streams for online POI recommendations. Specifically, we formulate the in-stream geo-human interaction modeling problem into a novel de…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Practical Data Poisoning Attack against Next-Item Recommendation
Online recommendation systems make use of a variety of information sources to provide users the items that users are potentially interested in. However, due to the openness of the online platform, recommendation systems …
Data PoisoningRecommendation SystemsReinforcement LearningA Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation
Reinforcement learning is effective in optimizing policies for recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with a real environment, and thus are expen…
Generative Adversarial NetworkModel-based Reinforcement LearningRecommendation Systemsreinforcement-learning+2Adversarial Robustness of Deep Reinforcement Learning based Dynamic Recommender Systems
Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The l…
Adversarial RobustnesscounterfactualDeep Reinforcement LearningInteractive Recommendation+4