Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learning
Interactive recommender system (IRS) has drawn huge attention because of its flexible recommendation strategy and the consideration of optimal long-term user experiences. To deal with the dynamic user preference and optimize accumulative utilities, researchers have introduced reinforcement learning (RL) into IRS. However, RL methods share a common issue of sample efficiency, i.e., huge amount of interaction data is required to train an effective recommendation policy, which is caused by the sparse user responses and the large action space consisting of a large number of candidate items. Moreover, it is infeasible to collect much data with explorative policies in online environments, which will probably harm user experience. In this work, we investigate the potential of leveraging knowledge graph (KG) in dealing with these issues of RL methods for IRS, which provides rich side information for recommendation decision making. Instead of learning RL policies from scratch, we make use of the prior knowledge of the item correlation learned from KG to (i) guide the candidate selection for better candidate item retrieval, (ii) enrich the representation of items and user states, and (iii) propagate user preferences among the correlated items over KG to deal with the sparsity of user feedback. Comprehensive experiments have been conducted on two real-world datasets, which demonstrate the superiority of our approach with significant improvements against state-of-the-arts.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingRecommendation Systemsreinforcement-learningReinforcement LearningReinforcement Learning (RL)RetrievalSimilar Papers 제목 키워드 기반
Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion
Conversational recommender systems (CRS) aim to recommend high-quality items to users through interactive conversations. Although several efforts have been made for CRS, two major issues still remain to be solved. First,…
Knowledge GraphsRecommendation SystemsText GenerationKnowledge Graph-enhanced Sampling for Conversational Recommender System
The traditional recommendation systems mainly use offline user data to train offline models, and then recommend items for online users, thus suffering from the unreliable estimation of user preferences based on sparse an…
Conversational RecommendationRecommendation SystemsKnowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendation
Accurate user and item embedding learning is crucial for modern recommender systems. However, most existing recommendation techniques have thus far focused on modeling users' preferences over singular type of user-item i…
Graph AttentionRecommendation SystemsMulti-Task Feature Learning for Knowledge Graph Enhanced Recommendation
Collaborative filtering often suffers from sparsity and cold start problems in real recommendation scenarios, therefore, researchers and engineers usually use side information to address the issues and improve the perfor…
Collaborative FilteringGraph EmbeddingKnowledge Graph EmbeddingKnowledge Graphs+3Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems
Conversational recommender systems (CRS) utilize natural language interactions and dialogue history to infer user preferences and provide accurate recommendations. Due to the limited conversation context and background k…
Knowledge GraphsLanguage ModelingLanguage ModellingRecommendation Systems+2