paper-with-me

Papers

NeuralDP Differentially private neural networks by design

2021-07-30 · Moritz Knolle, Dmitrii Usynin, Alexander Ziller, Marcus R. Makowski, Daniel Rueckert, Georgios Kaissis

The application of differential privacy to the training of deep neural networks holds the promise of allowing large-scale (decentralized) use of sensitive data while providing rigorous privacy guarantees to the individual. The predominant approach to differentially private training of neural networks is DP-SGD, which relies on norm-based gradient clipping as a method for bounding sensitivity, followed by the addition of appropriately calibrated Gaussian noise. In this work we propose NeuralDP, a technique for privatising activations of some layer within a neural network, which by the post-processing properties of differential privacy yields a differentially private network. We experimentally demonstrate on two datasets (MNIST and Pediatric Pneumonia Dataset (PPD)) that our method offers substantially improved privacy-utility trade-offs compared to DP-SGD.

📄 PDF Abstract BibTeX arXiv:2107.14582

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Gradient Clipping One difficulty that arises with optimization of deep neural networks is that large parameter gradients can lead an SGD optimizer to update…

Similar Papers 제목 키워드 기반

Differentially Private Decomposable Submodular Maximization

2020-05-29 · Anamay Chaturvedi, Huy Nguyen, Lydia Zakynthinou

We study the problem of differentially private constrained maximization of decomposable submodular functions. A submodular function is decomposable if it takes the form of a sum of submodular functions. The special case …

Nearly Optimal Private LASSO

2015-12-01 · NeurIPS 2015 12 · Kunal Talwar, Abhradeep Guha Thakurta, Li Zhang

We present a nearly optimal differentially private version of the well known LASSO estimator. Our algorithm provides privacy protection with respect to each training data item. The excess risk of our algorithm, compared …

JAX-Privacy: A library for differentially private machine learning

2026-02-19 · Ryan McKenna, Galen Andrew, Borja Balle, Vadym Doroshenko 외 arxiv

JAX-Privacy is a library designed to simplify the deployment of robust and performant mechanisms for differentially private machine learning. Guided by design principles of usability, flexibility, and efficiency, JAX-Pri…

Differentially Private Sliced Inverse Regression: Minimax Optimality and Algorithm

2024-01-16 · Xintao Xia, Linjun Zhang, Zhanrui Cai

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utiliz…

Dimensionality Reductionregression

Differentially Private Random Block Coordinate Descent

2024-12-22 · Artavazd Maranjyan, Abdurakhmon Sadiev, Peter Richtárik

Coordinate Descent (CD) methods have gained significant attention in machine learning due to their effectiveness in solving high-dimensional problems and their ability to decompose complex optimization tasks. However, cl…