Partially Encrypted Machine Learning using Functional Encryption
Machine learning on encrypted data has received a lot of attention thanks to recent breakthroughs in homomorphic encryption and secure multi-party computation. It allows outsourcing computation to untrusted servers without sacrificing privacy of sensitive data. We propose a practical framework to perform partially encrypted and privacy-preserving predictions which combines adversarial training and functional encryption. We first present a new functional encryption scheme to efficiently compute quadratic functions so that the data owner controls what can be computed but is not involved in the calculation: it provides a decryption key which allows one to learn a specific function evaluation of some encrypted data. We then show how to use it in machine learning to partially encrypt neural networks with quadratic activation functions at evaluation time, and we provide a thorough analysis of the information leaks based on indistinguishability of data items of the same label. Last, since most encryption schemes cannot deal with the last thresholding operation used for classification, we propose a training method to prevent selected sensitive features from leaking, which adversarially optimizes the network against an adversary trying to identify these features. This is interesting for several existing works using partially encrypted machine learning as it comes with little reduction on the model's accuracy and significantly improves data privacy.
Code (3)
Tasks
BIG-bench Machine LearningPrivacy PreservingSimilar Papers 제목 키워드 기반
Partially Encrypted Deep Learning using Functional Encryption
Machine learning on encrypted data has received a lot of attention thanks to recent breakthroughs in homomorphic encryption and secure multi-party computation. It allows outsourcing computation to untrusted servers witho…
BIG-bench Machine LearningDeep LearningPrivacy PreservingEncrypted Vector Similarity Computations Using Partially Homomorphic Encryption: Applications and Performance Analysis
This paper explores the use of partially homomorphic encryption (PHE) for encrypted vector similarity search, with a focus on facial recognition and broader applications like reverse image search, recommendation engines,…
Image RetrievalPrivacy PreservingSoK: Privacy Preserving Machine Learning using Functional Encryption: Opportunities and Challenges
With the advent of functional encryption, new possibilities for computation on encrypted data have arisen. Functional Encryption enables data owners to grant third-party access to perform specified computations without d…
BIG-bench Machine LearningCloud ComputingPrivacy PreservingFunctional Encryption in Secure Neural Network Training: Data Leakage and Practical Mitigations
With the increased interest in artificial intelligence, Machine Learning as a Service provides the infrastructure in the Cloud for easy training, testing, and deploying models. However, these systems have a major privacy…
NN-EMD: Efficiently Training Neural Networks using Encrypted Multi-Sourced Datasets
Training a machine learning model over an encrypted dataset is an existing promising approach to address the privacy-preserving machine learning task, however, it is extremely challenging to efficiently train a deep neur…
BIG-bench Machine LearningPrivacy Preserving