paper-with-me

Papers

Preference Diffusion for Recommendation

2024-10-17 · Shuo Liu, An Zhang, Guoqing Hu, Hong Qian, Tat-Seng Chua

Recommender systems predict personalized item rankings based on user preference distributions derived from historical behavior data. Recently, diffusion models (DMs) have gained attention in recommendation for their ability to model complex distributions, yet current DM-based recommenders often rely on traditional objectives like mean squared error (MSE) or recommendation objectives, which are not optimized for personalized ranking tasks or fail to fully leverage DM's generative potential. To address this, we propose PreferDiff, a tailored optimization objective for DM-based recommenders. PreferDiff transforms BPR into a log-likelihood ranking objective and integrates multiple negative samples to better capture user preferences. Specifically, we employ variational inference to handle the intractability through minimizing the variational upper bound and replaces MSE with cosine error to improve alignment with recommendation tasks. Finally, we balance learning generation and preference to enhance the training stability of DMs. PreferDiff offers three key benefits: it is the first personalized ranking loss designed specifically for DM-based recommenders and it improves ranking and faster convergence by addressing hard negatives. We also prove that it is theoretically connected to Direct Preference Optimization which indicates that it has the potential to align user preferences in DM-based recommenders via generative modeling. Extensive experiments across three benchmarks validate its superior recommendation performance and commendable general sequential recommendation capabilities. Our codes are available at https://github.com/lswhim/PreferDiff.

📄 PDF Abstract BibTeX arXiv:2410.13117

Code (1)

lswhim/preferdiff 공식 구현 pytorch

Tasks

Recommendation SystemsSequential RecommendationVariational Inference

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Variational Inference 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Beyond Negative Transfer: Disentangled Preference-Guided Diffusion for Cross-Domain Sequential Recommendation

2025-08-30 · Xiaoxin Ye, Chengkai Huang, Hongtao Huang, Lina Yao arxiv

Cross-Domain Sequential Recommendation (CDSR) leverages user behaviors across domains to enhance recommendation quality. However, naive aggregation of sequential signals can introduce conflicting domain-specific preferen…

Sequential RecommendationCollaborative Filtering

LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendation

2023-09-27 · Jiarui Zhu, Jun Hou, Penghang Yu, Zhiyi Tan 외

Multimedia recommendation aims to predict users' future behaviors based on observed behaviors and item content information. However, the inherent noise contained in observed behaviors easily leads to suboptimal recommend…

Multimedia recommendationRecommendation Systems

Time-Aware Diffusion based on Preference Disentanglement for Generative Recommendation

2026-06-01 · Bangguo Zhu, Peng Huo, Yuanbo Zhao, Zhicheng Du 외 arxiv

Recently, Generative Recommenders (GRs) have emerged as a transformative recommendation paradigm by replacing traditional item IDs with semantic indices (SIDs). Owing to the exceptional generative capabilities of diffusi…

A Diffusion model for POI recommendation

2023-04-14 · Yifang Qin, Hongjun Wu, Wei Ju, Xiao Luo 외

Next Point-of-Interest (POI) recommendation is a critical task in location-based services that aim to provide personalized suggestions for the user's next destination. Previous works on POI recommendation have laid focus…

model

Plug-in Diffusion Model for Sequential Recommendation

2024-01-05 · Haokai Ma, Ruobing Xie, Lei Meng, Xin Chen 외

Pioneering efforts have verified the effectiveness of the diffusion models in exploring the informative uncertainty for recommendation. Considering the difference between recommendation and image synthesis tasks, existin…

Image GenerationmodelModel OptimizationSequential Recommendation