paper-with-me

홈 › Papers

Differentially Private Decoupled Graph Convolutions for Multigranular Topology Protection

2023-09-21 · NeurIPS 2023 11

Graph Neural Networks (GNNs) have proven to be highly effective in solving real-world learning problems that involve graph-structured data. However, GNNs can also inadvertently expose sensitive user information and interactions through their model predictions. To address these privacy concerns, Differential Privacy (DP) protocols are employed to control the trade-off between provable privacy protection and model utility. Applying standard DP approaches to GNNs directly is not advisable due to two main reasons. First, the prediction of node labels, which relies on neighboring node attributes through graph convolutions, can lead to privacy leakage. Second, in practical applications, the privacy requirements for node attributes and graph topology may differ. In the latter setting, existing DP-GNN models fail to provide multigranular trade-offs between graph topology privacy, node attribute privacy, and GNN utility. To address both limitations, we propose a new framework termed Graph Differential Privacy (GDP), specifically tailored to graph learning. GDP ensures both provably private model parameters as well as private predictions. Additionally, we describe a novel unified notion of graph dataset adjacency to analyze the properties of GDP for different levels of graph topology privacy. Our findings reveal that DP-GNNs, which rely on graph convolutions, not only fail to meet the requirements for multigranular graph topology privacy but also necessitate the injection of DP noise that scales at least linearly with the maximum node degree. In contrast, our proposed Differentially Private Decoupled Graph Convolutions (DPDGCs) represent a more flexible and efficient alternative to graph convolutions that still provides the necessary guarantees of GDP. To validate our approach, we conducted extensive experiments on seven node classification benchmarking and illustrative synthetic datasets. The results demonstrate that DPDGCs significantly outperform existing DP-GNNs in terms of privacy-utility trade-offs.

📄 PDF Abstract BibTeX

Code (1)

thupchnsky/dp-gnn 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Differentially Private Graph Classification with GNNs

2022-02-05 · Tamara T. Mueller, Johannes C. Paetzold, Chinmay Prabhakar, Dmitrii Usynin 외

Graph Neural Networks (GNNs) have established themselves as the state-of-the-art models for many machine learning applications such as the analysis of social networks, protein interactions and molecules. Several among th…

BIG-bench Machine LearningClassificationGraph Classification

DP-AdamW: Investigating Decoupled Weight Decay and Bias Correction in Private Deep Learning

2025-11-11 · Jay Chooi, Kevin Cong, Russell Li, Lillian Sun arxiv

As deep learning methods increasingly utilize sensitive data on a widespread scale, differential privacy (DP) offers formal guarantees to protect against information leakage during model training. A significant challenge…

Image ClassificationNode ClassificationText Classification

Privacy-Preserving Reinforcement Learning from Human Feedback via Decoupled Reward Modeling

2026-03-23 · Young Hyun Cho, Will Wei Sun arxiv

Preference-based fine-tuning has become an important component in training large language models, and the data used at this stage may contain sensitive user information. A central question is how to design a differential…

Reinforcement Learning

Differentially Private Precision Matrix Estimation

2019-09-06 · Wenqing Su, Xiao Guo, Hai Zhang

In this paper, we study the problem of precision matrix estimation when the dataset contains sensitive information. In the differential privacy framework, we develop a differentially private ridge estimator by perturbing…

Differentially Private Range Subgraph Counting

2026-06-06 · Xian Chen, Ruobing Bai, Pan Peng arxiv

Subgraph counting is a fundamental problem in graph analysis. Motivated by practical scenarios where graph analytics are performed on subgraphs induced by selected vertices -- rather than on the entire graph -- and by gr…