Sequential Recommendation with Latent Relations based on Large Language Model
Sequential recommender systems predict items that may interest users by modeling their preferences based on historical interactions. Traditional sequential recommendation methods rely on capturing implicit collaborative filtering signals among items. Recent relation-aware sequential recommendation models have achieved promising performance by explicitly incorporating item relations into the modeling of user historical sequences, where most relations are extracted from knowledge graphs. However, existing methods rely on manually predefined relations and suffer the sparsity issue, limiting the generalization ability in diverse scenarios with varied item relations. In this paper, we propose a novel relation-aware sequential recommendation framework with Latent Relation Discovery (LRD). Different from previous relation-aware models that rely on predefined rules, we propose to leverage the Large Language Model (LLM) to provide new types of relations and connections between items. The motivation is that LLM contains abundant world knowledge, which can be adopted to mine latent relations of items for recommendation. Specifically, inspired by that humans can describe relations between items using natural language, LRD harnesses the LLM that has demonstrated human-like knowledge to obtain language knowledge representations of items. These representations are fed into a latent relation discovery module based on the discrete state variational autoencoder (DVAE). Then the self-supervised relation discovery tasks and recommendation tasks are jointly optimized. Experimental results on multiple public datasets demonstrate our proposed latent relations discovery method can be incorporated with existing relation-aware sequential recommendation models and significantly improve the performance. Further analysis experiments indicate the effectiveness and reliability of the discovered latent relations.
Code (1)
Tasks
Collaborative FilteringKnowledge GraphsLanguage ModelingLanguage ModellingLarge Language ModelRecommendation SystemsRelationSequential RecommendationWorld KnowledgeSimilar Papers 제목 키워드 기반
LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendation
Sequential recommendation aims to predict users' future interactions by modeling collaborative filtering (CF) signals from historical behaviors of similar users or items. Traditional sequential recommenders predominantly…
Collaborative FilteringSequential RecommendationSequential Recommendation with Causal Behavior Discovery
The key of sequential recommendation lies in the accurate item correlation modeling. Previous models infer such information based on item co-occurrences, which may fail to capture the real causal relations, and impact th…
Causal DiscoveryRecommendation SystemsSequential RecommendationBeyond Inter-Item Relations: Dynamic Adaption for Enhancing LLM-Based Sequential Recommendation
Sequential recommender systems (SRS) predict the next items that users may prefer based on user historical interaction sequences. Inspired by the rise of large language models (LLMs) in various AI applications, there is …
Bayesian OptimizationRecommendation SystemsSequential RecommendationAdversarial and Contrastive Variational Autoencoder for Sequential Recommendation
Sequential recommendation as an emerging topic has attracted increasing attention due to its important practical significance. Models based on deep learning and attention mechanism have achieved good performance in seque…
Collaborative FilteringSequential RecommendationCascading: Association Augmented Sequential Recommendation
Recently, recommendation according to sequential user behaviors has shown promising results in many application scenarios. Generally speaking, real-world sequential user behaviors usually reflect a hybrid of sequential i…
Graph EmbeddingSequential Recommendation