GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systems
Given the convenience of collecting information through online services, recommender systems now consume large scale data and play a more important role in improving user experience. With the recent emergence of Graph Neural Networks (GNNs), GNN-based recommender models have shown the advantage of modeling the recommender system as a user-item bipartite graph to learn representations of users and items. However, such models are expensive to train and difficult to perform frequent updates to provide the most up-to-date recommendations. In this work, we propose to update GNN-based recommender models incrementally so that the computation time can be greatly reduced and models can be updated more frequently. We develop a Graph Structure Aware Incremental Learning framework, GraphSAIL, to address the commonly experienced catastrophic forgetting problem that occurs when training a model in an incremental fashion. Our approach preserves a user's long-term preference (or an item's long-term property) during incremental model updating. GraphSAIL implements a graph structure preservation strategy which explicitly preserves each node's local structure, global structure, and self-information, respectively. We argue that our incremental training framework is the first attempt tailored for GNN based recommender systems and demonstrate its improvement compared to other incremental learning techniques on two public datasets. We further verify the effectiveness of our framework on a large-scale industrial dataset.
Code (1)
Tasks
Incremental LearningRecommendation SystemsSimilar Papers 제목 키워드 기반
Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems
Recommender systems now consume large-scale data and play a significant role in improving user experience. Graph Neural Networks (GNNs) have emerged as one of the most effective recommender system models because they mod…
Incremental LearningKnowledge DistillationRecommendation SystemsCausal Incremental Graph Convolution for Recommender System Retraining
Real-world recommender system needs to be regularly retrained to keep with the new data. In this work, we consider how to efficiently retrain graph convolution network (GCN) based recommender models, which are state-of-t…
Causal InferenceRecommendation SystemsIncremental Factorization Machines for Persistently Cold-starting Online Item Recommendation
Real-world item recommenders commonly suffer from a persistent cold-start problem which is caused by dynamically changing users and items. In order to overcome the problem, several context-aware recommendation techniques…
Recommendation SystemsKnowledge Aware Emotion Recognition in Textual Conversations via Multi-Task Incremental Transformer
Emotion recognition in textual conversations (ERTC) plays an important role in a wide range of applications, such as opinion mining, recommender systems, and so on. ERTC, however, is a challenging task. For one thing, sp…
Emotion RecognitionGraph AttentionMulti-Task LearningOpinion Mining+1Combining Privileged Information to Improve Context-Aware Recommender Systems
A recommender system is an information filtering technology which can be used to predict preference ratings of items (products, services, movies, etc) and/or to output a ranking of items that are likely to be of interest…
ClusteringRecommendation Systems