paper-with-me

홈 › Papers

Differentially Private Graph Neural Network with Importance-Grained Noise Adaption

2023-08-09 · Yuxin Qi, Xi Lin, Jun Wu

Graph Neural Networks (GNNs) with differential privacy have been proposed to preserve graph privacy when nodes represent personal and sensitive information. However, the existing methods ignore that nodes with different importance may yield diverse privacy demands, which may lead to over-protect some nodes and decrease model utility. In this paper, we study the problem of importance-grained privacy, where nodes contain personal data that need to be kept private but are critical for training a GNN. We propose NAP-GNN, a node-importance-grained privacy-preserving GNN algorithm with privacy guarantees based on adaptive differential privacy to safeguard node information. First, we propose a Topology-based Node Importance Estimation (TNIE) method to infer unknown node importance with neighborhood and centrality awareness. Second, an adaptive private aggregation method is proposed to perturb neighborhood aggregation from node-importance-grain. Third, we propose to privately train a graph learning algorithm on perturbed aggregations in adaptive residual connection mode over multi-layers convolution for node-wise tasks. Theoretically analysis shows that NAP-GNN satisfies privacy guarantees. Empirical experiments over real-world graph datasets show that NAP-GNN achieves a better trade-off between privacy and accuracy.

📄 PDF Abstract BibTeX arXiv:2308.04943

Code (0)

등록된 구현이 없습니다.

Tasks

Graph LearningGraph Neural NetworkPrivacy Preserving

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Differentially Private Stochastic Gradient Descent with Low-Noise

2022-09-09 · Puyu Wang, Yunwen Lei, Yiming Ying, Ding-Xuan Zhou

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theo…

Privacy Preserving

AdaDPIGU: Differentially Private SGD with Adaptive Clipping and Importance-Based Gradient Updates for Deep Neural Networks

2025-07-09 · Huiqi Zhang, Fang Xie arxiv

Differential privacy has been proven effective for stochastic gradient descent; however, existing methods often suffer from performance degradation in high-dimensional settings, as the scale of injected noise increases w…

DPIS: An Enhanced Mechanism for Differentially Private SGD with Importance Sampling

2022-10-18 · Jianxin Wei, Ergute Bao, Xiaokui Xiao, Yin Yang

Nowadays, differential privacy (DP) has become a well-accepted standard for privacy protection, and deep neural networks (DNN) have been immensely successful in machine learning. The combination of these two techniques, …

Feature EngineeringPrivacy Preserving

AdvSGM: Differentially Private Graph Learning via Adversarial Skip-gram Model

2025-03-27 · Sen Zhang, Qingqing Ye, Haibo Hu, Jianliang Xu

The skip-gram model (SGM), which employs a neural network to generate node vectors, serves as the basis for numerous popular graph embedding techniques. However, since the training datasets contain sensitive linkage info…

Graph EmbeddingGraph Learning

Constant matters: Fine-grained Complexity of Differentially Private Continual Observation

2022-02-23 · Hendrik Fichtenberger, Monika Henzinger, Jalaj Upadhyay

We study fine-grained error bounds for differentially private algorithms for counting under continual observation. Our main insight is that the matrix mechanism when using lower-triangular matrices can be used in the con…