paper-with-me

Papers

ContextGNN: Beyond Two-Tower Recommendation Systems

2024-11-29 · Yiwen Yuan, Zecheng Zhang, Xinwei He, Akihiro Nitta, Weihua Hu, Dong Wang, Manan Shah, Shenyang Huang, Blaž Stojanovič, Alan Krumholz, Jan Eric Lenssen, Jure Leskovec, Matthias Fey

Recommendation systems predominantly utilize two-tower architectures, which evaluate user-item rankings through the inner product of their respective embeddings. However, one key limitation of two-tower models is that they learn a pair-agnostic representation of users and items. In contrast, pair-wise representations either scale poorly due to their quadratic complexity or are too restrictive on the candidate pairs to rank. To address these issues, we introduce Context-based Graph Neural Networks (ContextGNNs), a novel deep learning architecture for link prediction in recommendation systems. The method employs a pair-wise representation technique for familiar items situated within a user's local subgraph, while leveraging two-tower representations to facilitate the recommendation of exploratory items. A final network then predicts how to fuse both pair-wise and two-tower recommendations into a single ranking of items. We demonstrate that ContextGNN is able to adapt to different data characteristics and outperforms existing methods, both traditional and GNN-based, on a diverse set of practical recommendation tasks, improving performance by 20% on average.

📄 PDF Abstract BibTeX arXiv:2411.19513

Code (1)

kumo-ai/ContextGNN 공식 구현 pytorch

Tasks

Link PredictionRecommendation Systems

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

ContextGNN goes to Elliot: Towards Benchmarking Relational Deep Learning for Static Link Prediction (aka Personalized Item Recommendation)

2025-03-20 · Alejandro Ariza-Casabona, Nikos Kanakaris, Daniele Malitesta

Relational deep learning (RDL) settles among the most exciting advances in machine learning for relational databases, leveraging the representational power of message passing graph neural networks (GNNs) to derive useful…

BenchmarkingLink PredictionRecommendation Systems

Zero Shot on the Cold-Start Problem: Model-Agnostic Interest Learning for Recommender Systems

2021-08-31 · Philip J. Feng, Pingjun Pan, Tingting Zhou, Hongxiang Chen 외

User behavior has been validated to be effective in revealing personalized preferences for commercial recommendations. However, few user-item interactions can be collected for new users, which results in a null space for…

Recommendation Systems

Exploring Heterogeneous Metadata for Video Recommendation with Two-tower Model

2021-09-22 · Jianling Wang, Ainur Yessenalina, Alireza Roshan-Ghias

Online video services acquire new content on a daily basis to increase engagement, and improve the user experience. Traditional recommender systems solely rely on watch history, delaying the recommendation of newly added…

Recommendation SystemsVocal Bursts Valence Prediction

Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendation

2023-11-30 · Liangcai Su, Fan Yan, Jieming Zhu, Xi Xiao 외

Two-tower models are a prevalent matching framework for recommendation, which have been widely deployed in industrial applications. The success of two-tower matching attributes to its efficiency in retrieval among a larg…

Retrieval

A Dual Augmented Two-tower Model for Online Large-scale Recommendation

2021-08-15 · DLP-KDD 2021 8 · Yantao Yu, Weipeng Wang, Zhoutian Feng, Daiyue Xue

Many modern recommender systems have a very large corpus, and a common industrial recipe for handling large-scale retrieval is to learn query and item representations from their content features with the two-tower model.…

Recommendation Systems