Graph-less Collaborative Filtering
Graph neural networks (GNNs) have shown the power in representation learning over graph-structured user-item interaction data for collaborative filtering (CF) task. However, with their inherently recursive message propagation among neighboring nodes, existing GNN-based CF models may generate indistinguishable and inaccurate user (item) representations due to the over-smoothing and noise effect with low-pass Laplacian smoothing operators. In addition, the recursive information propagation with the stacked aggregators in the entire graph structures may result in poor scalability in practical applications. Motivated by these limitations, we propose a simple and effective collaborative filtering model (SimRec) that marries the power of knowledge distillation and contrastive learning. In SimRec, adaptive transferring knowledge is enabled between the teacher GNN model and a lightweight student network, to not only preserve the global collaborative signals, but also address the over-smoothing issue with representation recalibration. Empirical results on public datasets show that SimRec archives better efficiency while maintaining superior recommendation performance compared with various strong baselines. Our implementations are publicly available at: https://github.com/HKUDS/SimRec.
Code (1)
Tasks
Collaborative FilteringContrastive LearningKnowledge DistillationRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
Graph Convolution Network (GCN) has become new state-of-the-art for collaborative filtering. Nevertheless, the reasons of its effectiveness for recommendation are not well understood. Existing work that adapts GCN to rec…
Collaborative FilteringGraph ClassificationMulti-modal RecommendationRecommendation Systemscf2vec: Collaborative Filtering algorithm selection using graph distributed representations
Algorithm selection using Metalearning aims to find mappings between problem characteristics (i.e. metafeatures) with relative algorithm performance to predict the best algorithm(s) for new datasets. Therefore, it is of …
Collaborative FilteringRepresentation LearningFeedback Reciprocal Graph Collaborative Filtering
Collaborative filtering on user-item interaction graphs has achieved success in the industrial recommendation. However, recommending users' truly fascinated items poses a seesaw dilemma for collaborative filtering models…
Collaborative FilteringContrastive LearningRecommendation SystemsKGUF: Simple Knowledge-aware Graph-based Recommender with User-based Semantic Features Filtering
The recent integration of Graph Neural Networks (GNNs) into recommendation has led to a novel family of Collaborative Filtering (CF) approaches, namely Graph Collaborative Filtering (GCF). Following the same GNNs wave, r…
Collaborative FilteringKnowledge GraphsRecommendation SystemsDisentangled Graph Collaborative Filtering
Learning informative representations of users and items from the interaction data is of crucial importance to collaborative filtering (CF). Present embedding functions exploit user-item relationships to enrich the repres…
Collaborative FilteringDisentanglement