paper-with-me

홈 › Papers

Improving Robustness to Model Inversion Attacks via Sparse Coding Architectures

2024-03-21 · Sayanton V. Dibbo, Adam Breuer, Juston Moore, Michael Teti

Recent model inversion attack algorithms permit adversaries to reconstruct a neural network's private and potentially sensitive training data by repeatedly querying the network. In this work, we develop a novel network architecture that leverages sparse-coding layers to obtain superior robustness to this class of attacks. Three decades of computer science research has studied sparse coding in the context of image denoising, object recognition, and adversarial misclassification settings, but to the best of our knowledge, its connection to state-of-the-art privacy vulnerabilities remains unstudied. In this work, we hypothesize that sparse coding architectures suggest an advantageous means to defend against model inversion attacks because they allow us to control the amount of irrelevant private information encoded by a network in a manner that is known to have little effect on classification accuracy. Specifically, compared to networks trained with a variety of state-of-the-art defenses, our sparse-coding architectures maintain comparable or higher classification accuracy while degrading state-of-the-art training data reconstructions by factors of 1.1 to 18.3 across a variety of reconstruction quality metrics (PSNR, SSIM, FID). This performance advantage holds across 5 datasets ranging from CelebA faces to medical images and CIFAR-10, and across various state-of-the-art SGD-based and GAN-based inversion attacks, including Plug-&-Play attacks. We provide a cluster-ready PyTorch codebase to promote research and standardize defense evaluations.

📄 PDF Abstract BibTeX arXiv:2403.14772

Code (1)

sayantondibbo/sca 공식 구현 pytorch

Tasks

DenoisingImage DenoisingObject RecognitionSSIM

Similar Papers 제목 키워드 기반

On the Vulnerability of Skip Connections to Model Inversion Attacks

2024-09-03 · Jun Hao Koh, Sy-Tuyen Ho, Ngoc-Bao Nguyen, Ngai-Man Cheung

Skip connections are fundamental architecture designs for modern deep neural networks (DNNs) such as CNNs and ViTs. While they help improve model performance significantly, we identify a vulnerability associated with ski…

Model Inversion Robustness: Can Transfer Learning Help?

2024-05-09 · CVPR 2024 1 · Sy-Tuyen Ho, Koh Jun Hao, Keshigeyan Chandrasegaran, Ngoc-Bao Nguyen 외

Model Inversion (MI) attacks aim to reconstruct private training data by abusing access to machine learning models. Contemporary MI attacks have achieved impressive attack performance, posing serious threats to privacy. …

modelTransfer Learning

SPEAR++: Scaling Gradient Inversion via Sparsely-Used Dictionary Learning

2025-10-28 · Alexander Bakarsky, Dimitar I. Dimitrov, Maximilian Baader, Martin Vechev arxiv

Federated Learning has seen an increased deployment in real-world scenarios recently, as it enables the distributed training of machine learning models without explicit data sharing between individual clients. Yet, the i…

Federated Learning

Robust or Private? Adversarial Training Makes Models More Vulnerable to Privacy Attacks

2019-06-15 · Felipe A. Mejia, Paul Gamble, Zigfried Hampel-Arias, Michael Lomnitz 외

Adversarial training was introduced as a way to improve the robustness of deep learning models to adversarial attacks. This training method improves robustness against adversarial attacks, but increases the models vulner…

Generative Adversarial Network

Classifiers Based on Deep Sparse Coding Architectures are Robust to Deep Learning Transferable Examples

2018-11-17 · Jacob M. Springer, Charles S. Strauss, Austin M. Thresher, Edward Kim 외

Although deep learning has shown great success in recent years, researchers have discovered a critical flaw where small, imperceptible changes in the input to the system can drastically change the output classification. …

Deep LearningGeneral Classification