paper-with-me

홈 › Papers

Distributionally Robust Graph Out-of-Distribution Recommendation via Diffusion Model

2025-01-26 · Chu Zhao, Enneng Yang, Yuliang Liang, Jianzhe Zhao, Guibing Guo, Xingwei Wang

The distributionally robust optimization (DRO)-based graph neural network methods improve recommendation systems' out-of-distribution (OOD) generalization by optimizing the model's worst-case performance. However, these studies fail to consider the impact of noisy samples in the training data, which results in diminished generalization capabilities and lower accuracy. Through experimental and theoretical analysis, this paper reveals that current DRO-based graph recommendation methods assign greater weight to noise distribution, leading to model parameter learning being dominated by it. When the model overly focuses on fitting noise samples in the training data, it may learn irrelevant or meaningless features that cannot be generalized to OOD data. To address this challenge, we design a Distributionally Robust Graph model for OOD recommendation (DRGO). Specifically, our method first employs a simple and effective diffusion paradigm to alleviate the noisy effect in the latent space. Additionally, an entropy regularization term is introduced in the DRO objective function to avoid extreme sample weights in the worst-case distribution. Finally, we provide a theoretical proof of the generalization error bound of DRGO as well as a theoretical analysis of how our approach mitigates noisy sample effects, which helps to better understand the proposed framework from a theoretical perspective. We conduct extensive experiments on four datasets to evaluate the effectiveness of our framework against three typical distribution shifts, and the results demonstrate its superiority in both independently and identically distributed distributions (IID) and OOD.

📄 PDF Abstract BibTeX arXiv:2501.15555

Code (1)

user683/DRGO 공식 구현 pytorch

Tasks

Graph Neural NetworkRecommendation Systems

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Graph Neural Network 설명 없음
Entropy Regularization 설명 없음

Similar Papers 제목 키워드 기반

Distributionally Robust Graph-based Recommendation System

2024-02-20 · Bohao Wang, Jiawei Chen, Changdong Li, Sheng Zhou 외

With the capacity to capture high-order collaborative signals, Graph Neural Networks (GNNs) have emerged as powerful methods in Recommender Systems (RS). However, their efficacy often hinges on the assumption that traini…

Recommendation Systems

3D-Learning: Diffusion-Augmented Distributionally Robust Decision-Focused Learning

2026-02-03 · Jiaqi Wen, Lei Fan, Jianyi Yang arxiv

Predict-then-Optimize (PTO) pipelines are widely employed in computing and networked systems, where Machine Learning (ML) models are used to predict critical contextual information for downstream decision-making tasks su…

Data Augmentation

Distributionally Robust Path Integral Control

2023-10-02 · Hyuk Park, Duo Zhou, Grani A. Hanasusanto, Takashi Tanaka

We consider a continuous-time continuous-space stochastic optimal control problem, where the controller lacks exact knowledge of the underlying diffusion process, relying instead on a finite set of historical disturbance…

Distributionally Robust Optimization via Diffusion Ambiguity Modeling

2025-10-26 · Jiaqi Wen, Jianyi Yang arxiv

This paper studies Distributionally Robust Optimization (DRO), a fundamental framework for enhancing the robustness and generalization of statistical learning and optimization. An effective ambiguity set for DRO must inv…

Distributionally Robust Learning

2021-08-20 · Ruidi Chen, Ioannis Ch. Paschalidis

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning…

Decision Makingregression