paper-with-me

Papers

Self-Guided Learning to Denoise for Robust Recommendation

2022-04-14 · Yunjun Gao, Yuntao Du, Yujia Hu, Lu Chen, Xinjun Zhu, Ziquan Fang, Baihua Zheng

The ubiquity of implicit feedback makes them the default choice to build modern recommender systems. Generally speaking, observed interactions are considered as positive samples, while unobserved interactions are considered as negative ones. However, implicit feedback is inherently noisy because of the ubiquitous presence of noisy-positive and noisy-negative interactions. Recently, some studies have noticed the importance of denoising implicit feedback for recommendations, and enhanced the robustness of recommendation models to some extent. Nonetheless, they typically fail to (1) capture the hard yet clean interactions for learning comprehensive user preference, and (2) provide a universal denoising solution that can be applied to various kinds of recommendation models. In this paper, we thoroughly investigate the memorization effect of recommendation models, and propose a new denoising paradigm, i.e., Self-Guided Denoising Learning (SGDL), which is able to collect memorized interactions at the early stage of the training (i.e., "noise-resistant" period), and leverage those data as denoising signals to guide the following training (i.e., "noise-sensitive" period) of the model in a meta-learning manner. Besides, our method can automatically switch its learning phase at the memorization point from memorization to self-guided learning, and select clean and informative memorized data via a novel adaptive denoising scheduler to improve the robustness. We incorporate SGDL with four representative recommendation models (i.e., NeuMF, CDAE, NGCF and LightGCN) and different loss functions (i.e., binary cross-entropy and BPR loss). The experimental results on three benchmark datasets demonstrate the effectiveness of SGDL over the state-of-the-art denoising methods like T-CE, IR, DeCA, and even state-of-the-art robust graph-based methods like SGCN and SGL.

📄 PDF Abstract BibTeX arXiv:2204.06832

Code (2)

ZJU-DAILY/SGDL 공식 구현 pytorch
scottdyt/sgdl 공식 구현 pytorch

Tasks

DenoisingMemorizationMeta-LearningRecommendation Systems

Similar Papers 제목 키워드 기반

GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models

2026-05-28 · Xiaohang Tang, Keyue Jiang, Che Liu, Qifang Zhao 외 arxiv

Reinforcement learning (RL) can be used to improve the policy (denoiser) of diffusion large language models (dLLMs), while being hindered by the intractability of the policy likelihood. A dominant and efficient family of…

Reinforcement Learning

Robust Preference-Guided Denoising for Graph based Social Recommendation

2023-03-15 · Yuhan Quan, Jingtao Ding, Chen Gao, Lingling Yi 외

Graph Neural Network(GNN) based social recommendation models improve the prediction accuracy of user preference by leveraging GNN in exploiting preference similarity contained in social relations. However, in terms of bo…

DenoisingGraph Neural NetworkRelation

Denoised Self-Augmented Learning for Social Recommendation

2023-05-22 · Tianle Wang, Lianghao Xia, Chao Huang

Social recommendation is gaining increasing attention in various online applications, including e-commerce and online streaming, where social information is leveraged to improve user-item interaction modeling. Recently, …

Self-Supervised LearningTransfer Learning

Graph Bottlenecked Social Recommendation

2024-06-12 · Yonghui Yang, Le Wu, Zihan Wang, Zhuangzhuang He 외

With the emergence of social networks, social recommendation has become an essential technique for personalized services. Recently, graph-based social recommendations have shown promising results by capturing the high-or…

Denoising

Ditch the Denoiser: Emergence of Noise Robustness in Self-Supervised Learning from Data Curriculum

2025-05-18 · Wenquan Lu, JiaQi Zhang, Hugues van Assel, Randall Balestriero

Self-Supervised Learning (SSL) has become a powerful solution to extract rich representations from unlabeled data. Yet, SSL research is mostly focused on clean, curated and high-quality datasets. As a result, applying SS…

GeophysicsRepresentation LearningSelf-Supervised Learning