paper-with-me

Papers

Collaborative Filtering Based on Diffusion Models: Unveiling the Potential of High-Order Connectivity

2024-04-22 · Yu Hou, Jin-Duk Park, Won-Yong Shin

A recent study has shown that diffusion models are well-suited for modeling the generative process of user-item interactions in recommender systems due to their denoising nature. However, existing diffusion model-based recommender systems do not explicitly leverage high-order connectivities that contain crucial collaborative signals for accurate recommendations. Addressing this gap, we propose CF-Diff, a new diffusion model-based collaborative filtering (CF) method, which is capable of making full use of collaborative signals along with multi-hop neighbors. Specifically, the forward-diffusion process adds random noise to user-item interactions, while the reverse-denoising process accommodates our own learning model, named cross-attention-guided multi-hop autoencoder (CAM-AE), to gradually recover the original user-item interactions. CAM-AE consists of two core modules: 1) the attention-aided AE module, responsible for precisely learning latent representations of user-item interactions while preserving the model's complexity at manageable levels, and 2) the multi-hop cross-attention module, which judiciously harnesses high-order connectivity information to capture enhanced collaborative signals. Through comprehensive experiments on three real-world datasets, we demonstrate that CF-Diff is (a) Superior: outperforming benchmark recommendation methods, achieving remarkable gains up to 7.29% compared to the best competitor, (b) Theoretically-validated: reducing computations while ensuring that the embeddings generated by our model closely approximate those from the original cross-attention, and (c) Scalable: proving the computational efficiency that scales linearly with the number of users or items.

📄 PDF Abstract BibTeX arXiv:2404.14240

Code (1)

jackfrost168/cf_diff 공식 구현 pytorch

Tasks

Collaborative FilteringComputational EfficiencyDenoisingRecommendation Systems

Methods 이 논문이 사용한 방법론

AE An autoencoder is a type of artificial neural network used to learn efficient data codings in an unsupervised manner. The aim of an autoencoder is to learn a representation…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Graph Signal Diffusion Model for Collaborative Filtering

2023-11-15 · Yunqin Zhu, Chao Wang, Qi Zhang, Hui Xiong

Collaborative filtering is a critical technique in recommender systems. It has been increasingly viewed as a conditional generative task for user feedback data, where newly developed diffusion model shows great potential…

Collaborative FilteringDenoisingmodelRecommendation Systems

Graph-based Diffusion Model for Collaborative Filtering

2025-04-07 · Xuan Zhang, Xiang Deng, Hongxing Yuan, Chunyu Wei 외

Recently, diffusion-based recommendation methods have achieved impressive results. However, existing approaches predominantly treat each user's historical interactions as independent training samples, overlooking the pot…

Collaborative Filteringmodel

Diffusion-augmented Graph Contrastive Learning for Collaborative Filter

2025-03-20 · Fan Huang, Wei Wang

Graph-based collaborative filtering has been established as a prominent approach in recommendation systems, leveraging the inherent graph topology of user-item interactions to model high-order connectivity patterns and e…

Collaborative FilteringContrastive LearningData AugmentationRecommendation Systems+1

Unveiling Contrastive Learning's Capability of Neighborhood Aggregation for Collaborative Filtering

2025-04-14 · Yu Zhang, Yiwen Zhang, Yi Zhang, Lei Sang 외

Personalized recommendation is widely used in the web applications, and graph contrastive learning (GCL) has gradually become a dominant approach in recommender systems, primarily due to its ability to extract self-super…

Collaborative FilteringContrastive LearningData AugmentationMisconceptions+1

S-Diff: An Anisotropic Diffusion Model for Collaborative Filtering in Spectral Domain

2024-12-31 · Rui Xia, Yanhua Cheng, Yongxiang Tang, Xiaocheng Liu 외

Recovering user preferences from user-item interaction matrices is a key challenge in recommender systems. While diffusion models can sample and reconstruct preferences from latent distributions, they often fail to captu…

Collaborative FilteringDenoisingRecommendation Systems