Text-Based Interactive Recommendation via Constraint-Augmented Reinforcement Learning
Text-based interactive recommendation provides richer user preferences and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past natural-language feedback, since the recommender needs to explore new items for further improvement. To alleviate this issue, we propose a novel constraint-augmented reinforcement learning (RL) framework to efficiently incorporate user preferences over time. Specifically, we leverage a discriminator to detect recommendations violating user historical preference, which is incorporated into the standard RL objective of maximizing expected cumulative future rewards. Our proposed framework is general and is further extended to the task of constrained text generation. Empirical results show that the proposed method yields consistent improvement relative to standard RL methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Interactive RecommendationRecommendation Systemsreinforcement-learningReinforcement LearningReinforcement Learning (RL)Text GenerationSimilar Papers 제목 키워드 기반
Reward Constrained Interactive Recommendation with Natural Language Feedback
Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from …
Interactive RecommendationRecommendation Systemsreinforcement-learningReinforcement Learning (RL)+1A General Offline Reinforcement Learning Framework for Interactive Recommendation
This paper studies the problem of learning interactive recommender systems from logged feedbacks without any exploration in online environments. We address the problem by proposing a general offline reinforcement learnin…
Interactive RecommendationRecommendation Systemsreinforcement-learningReinforcement LearningKnowledge-guided Deep Reinforcement Learning for Interactive Recommendation
Interactive recommendation aims to learn from dynamic interactions between items and users to achieve responsiveness and accuracy. Reinforcement learning is inherently advantageous for coping with dynamic environments an…
Decision MakingDeep Reinforcement LearningInteractive RecommendationKnowledge-Aware Recommendation+4Digital Human Interactive Recommendation Decision-Making Based on Reinforcement Learning
Digital human recommendation system has been developed to help customers find their favorite products and is playing an active role in various recommendation contexts. How to timely catch and learn the dynamics of the pr…
Decision MakingGraph EmbeddingInteractive Recommendationreinforcement-learning+2Fairness Begins with State: Purifying Latent Preferences for Hierarchical Reinforcement Learning in Interactive Recommendation
Interactive recommender systems (IRS) are increasingly optimized with Reinforcement Learning (RL) to capture the sequential nature of user-system dynamics. However, existing fairness-aware methods often suffer from a fun…
Hierarchical Reinforcement Learning