paper-with-me

홈 › Papers

Denoising Diffusion Recommender Model

2024-01-13 · Jujia Zhao, Wenjie Wang, Yiyan Xu, Teng Sun, Fuli Feng, Tat-Seng Chua

Recommender systems often grapple with noisy implicit feedback. Most studies alleviate the noise issues from data cleaning perspective such as data resampling and reweighting, but they are constrained by heuristic assumptions. Another denoising avenue is from model perspective, which proactively injects noises into user-item interactions and enhances the intrinsic denoising ability of models. However, this kind of denoising process poses significant challenges to the recommender model's representation capacity to capture noise patterns. To address this issue, we propose Denoising Diffusion Recommender Model (DDRM), which leverages multi-step denoising process of diffusion models to robustify user and item embeddings from any recommender models. DDRM injects controlled Gaussian noises in the forward process and iteratively removes noises in the reverse denoising process, thereby improving embedding robustness against noisy feedback. To achieve this target, the key lies in offering appropriate guidance to steer the reverse denoising process and providing a proper starting point to start the forward-reverse process during inference. In particular, we propose a dedicated denoising module that encodes collaborative information as denoising guidance. Besides, in the inference stage, DDRM utilizes the average embeddings of users' historically liked items as the starting point rather than using pure noise since pure noise lacks personalization, which increases the difficulty of the denoising process. Extensive experiments on three datasets with three representative backend recommender models demonstrate the effectiveness of DDRM.

📄 PDF Abstract BibTeX arXiv:2401.06982

Code (1)

polaris-jz/ddrm 공식 구현 pytorch

Tasks

DenoisingmodelRecommendation SystemsRepresentation Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Collaborative Diffusion Model for Recommender System

2025-01-31 · Gyuseok Lee, Yaochen Zhu, Hwanjo Yu, Yao Zhou 외

Diffusion-based recommender systems (DR) have gained increasing attention for their advanced generative and denoising capabilities. However, existing DR face two central limitations: (i) a trade-off between enhancing gen…

DenoisingmodelRecommendation Systems

Fine-Tuning Diffusion-Based Recommender Systems via Reinforcement Learning with Reward Function Optimization

2025-11-10 · Yu Hou, Hua Li, Ha Young Kim, Won-Yong Shin arxiv

Diffusion models recently emerged as a powerful paradigm for recommender systems, offering state-of-the-art performance by modeling the generative process of user-item interactions. However, training such models from scr…

Sequential RecommendationReinforcement Learning

Unconditional Diffusion for Generative Sequential Recommendation

2025-07-08 · Yimeng Bai, Yang Zhang, Sihao Ding, Shaohui Ruan 외

Diffusion models, known for their generative ability to simulate data creation through noise-adding and denoising processes, have emerged as a promising approach for building generative recommenders. To incorporate user …

DenoisingSequential RecommendationTranslation

Collaborative Filtering Based on Diffusion Models: Unveiling the Potential of High-Order Connectivity

2024-04-22 · Yu Hou, Jin-Duk Park, Won-Yong Shin

A recent study has shown that diffusion models are well-suited for modeling the generative process of user-item interactions in recommender systems due to their denoising nature. However, existing diffusion model-based r…

Collaborative FilteringComputational EfficiencyDenoisingRecommendation Systems

A Directional Diffusion Graph Transformer for Recommendation

2024-04-04 · Zixuan Yi, Xi Wang, Iadh Ounis

In real-world recommender systems, implicitly collected user feedback, while abundant, often includes noisy false-positive and false-negative interactions. The possible misinterpretations of the user-item interactions po…

DenoisingRecommendation Systems