When Collaborative Filtering Meets Reinforcement Learning

2019-02-02 · Yu Lei, Wenjie Li

In this paper, we study a multi-step interactive recommendation problem, where the item recommended at current step may affect the quality of future recommendations. To address the problem, we develop a novel and effective approach, named CFRL, which seamlessly integrates the ideas of both collaborative filtering (CF) and reinforcement learning (RL). More specifically, we first model the recommender-user interactive recommendation problem as an agent-environment RL task, which is mathematically described by a Markov decision process (MDP). Further, to achieve collaborative recommendations for the entire user community, we propose a novel CF-based MDP by encoding the states of all users into a shared latent vector space. Finally, we propose an effective Q-network learning method to learn the agent's optimal policy based on the CF-based MDP. The capability of CFRL is demonstrated by comparing its performance against a variety of existing methods on real-world datasets.

📄 PDF Abstract BibTeX arXiv:1902.00715

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative FilteringInteractive Recommendationreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

When Product Search Meets Collaborative Filtering: A Hierarchical Heterogeneous Graph Neural Network Approach

2021-08-17 · Xiangkun Yin, Yangyang Guo, Liqiang Nie, Zhiyong Cheng

Personalization lies at the core of boosting the product search system performance. Prior studies mainly resorted to the semantic matching between textual queries and user/product related documents, leaving the user coll…

Collaborative Filtering Graph Neural Network Representation Learning Sentence

Collaborative Filtering Meets Spectrum Shift: Connecting User-Item Interaction with Graph-Structured Side Information

2025-02-12 · Yunhang He, Cong Xu, Jun Wang, Wei zhang

Graph Neural Networks (GNNs) have demonstrated their superiority in collaborative filtering, where the user-item (U-I) interaction bipartite graph serves as the fundamental data format. However, when graph-structured sid…

Collaborative Filtering Multimodal Recommendation

Collaborative Filtering Ensemble for Personalized Name Recommendation

2014-07-16 · Bernat Coma-Puig, Ernesto Diaz-Aviles, Wolfgang Nejdl

Out of thousands of names to choose from, picking the right one for your child is a daunting task. In this work, our objective is to help parents making an informed decision while choosing a name for their baby. We follo…

Collaborative Filtering Recommendation Systems

Multi-User Reinforcement Learning with Low Rank Rewards

2022-10-11 · Naman Agarwal, Prateek Jain, Suhas Kowshik, Dheeraj Nagaraj 외

In this work, we consider the problem of collaborative multi-user reinforcement learning. In this setting there are multiple users with the same state-action space and transition probabilities but with different rewards.…

Collaborative Filtering reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Transfer Meets Hybrid: A Synthetic Approach for Cross-Domain Collaborative Filtering with Text

2019-01-22 · Guang-Neng Hu, Yu Zhang, Qiang Yang

Collaborative filtering (CF) is the key technique for recommender systems (RSs). CF exploits user-item behavior interactions (e.g., clicks) only and hence suffers from the data sparsity issue. One research thread is to i…

Collaborative Filtering Movie Recommendation Recommendation Systems Transfer Learning