Contrastive Representation for Interactive Recommendation
Interactive Recommendation (IR) has gained significant attention recently for its capability to quickly capture dynamic interest and optimize both short and long term objectives. IR agents are typically implemented through Deep Reinforcement Learning (DRL), because DRL is inherently compatible with the dynamic nature of IR. However, DRL is currently not perfect for IR. Due to the large action space and sample inefficiency problem, training DRL recommender agents is challenging. The key point is that useful features cannot be extracted as high-quality representations for the recommender agent to optimize its policy. To tackle this problem, we propose Contrastive Representation for Interactive Recommendation (CRIR). CRIR efficiently extracts latent, high-level preference ranking features from explicit interaction, and leverages the features to enhance users' representation. Specifically, the CRIR provides representation through one representation network, and refines it through our proposed Preference Ranking Contrastive Learning (PRCL). The key insight of PRCL is that it can perform contrastive learning without relying on computations involving high-level representations or large potential action sets. Furthermore, we also propose a data exploiting mechanism and an agent training mechanism to better adapt CRIR to the DRL backbone. Extensive experiments have been carried out to show our method's superior improvement on the sample efficiency while training an DRL-based IR agent.
Code (1)
Tasks
Contrastive LearningDeep Reinforcement LearningInteractive RecommendationRecommendation SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Knowledge-aware Recommendation with Multi-level Interactive Contrastive Learning
Incorporating Knowledge Graphs (KG) into recommeder system has attracted considerable attention. Recently, the technical trend of Knowledge-aware Recommendation (KGR) is to develop end-to-end models based on graph neural…
Contrastive LearningKnowledge-Aware RecommendationKnowledge GraphsRepresentation Learning+1Contrastive Learning Method for Sequential Recommendation based on Multi-Intention Disentanglement
Sequential recommendation is one of the important branches of recommender system, aiming to achieve personalized recommended items for the future through the analysis and prediction of users' ordered historical interacti…
Contrastive LearningDisentanglementRecommendation SystemsSequential RecommendationDebiased Model-based Interactive Recommendation
Existing model-based interactive recommendation systems are trained by querying a world model to capture the user preference, but learning the world model from historical logged data will easily suffer from bias issues s…
Contrastive LearningInteractive RecommendationmodelRecommendation SystemsKnowledge Enhancement for Contrastive Multi-Behavior Recommendation
A well-designed recommender system can accurately capture the attributes of users and items, reflecting the unique preferences of individuals. Traditional recommendation techniques usually focus on modeling the singular …
Contrastive LearningRecommendation SystemsTAGSupervised Contrastive Learning for Recommendation
In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called sup…
Collaborative FilteringContrastive LearningSelf-Supervised Learning