paper-with-me

홈 › Papers

Privacy-Preserving Inference in Machine Learning Services Using Trusted Execution Environments

2019-12-07 · Krishna Giri Narra, Zhifeng Lin, Yongqin Wang, Keshav Balasubramaniam, Murali Annavaram

This work presents Origami, which provides privacy-preserving inference for large deep neural network (DNN) models through a combination of enclave execution, cryptographic blinding, interspersed with accelerator-based computation. Origami partitions the ML model into multiple partitions. The first partition receives the encrypted user input within an SGX enclave. The enclave decrypts the input and then applies cryptographic blinding to the input data and the model parameters. Cryptographic blinding is a technique that adds noise to obfuscate data. Origami sends the obfuscated data for computation to an untrusted GPU/CPU. The blinding and de-blinding factors are kept private by the SGX enclave, thereby preventing any adversary from denoising the data, when the computation is offloaded to a GPU/CPU. The computed output is returned to the enclave, which decodes the computation on noisy data using the unblinding factors privately stored within SGX. This process may be repeated for each DNN layer, as has been done in prior work Slalom. However, the overhead of blinding and unblinding the data is a limiting factor to scalability. Origami relies on the empirical observation that the feature maps after the first several layers can not be used, even by a powerful conditional GAN adversary to reconstruct input. Hence, Origami dynamically switches to executing the rest of the DNN layers directly on an accelerator without needing any further cryptographic blinding intervention to preserve privacy. We empirically demonstrate that using Origami, a conditional GAN adversary, even with an unlimited inference budget, cannot reconstruct the input. We implement and demonstrate the performance gains of Origami using the VGG-16 and VGG-19 models. Compared to running the entire VGG-19 model within SGX, Origami inference improves the performance of private inference from 11x while using Slalom to 15.1x.

📄 PDF Abstract BibTeX arXiv:1912.03485

Code (1)

cjbaq-origami/origami_inference 공식 구현 tf

Tasks

BIG-bench Machine LearningCPUDenoisingGPUPrivacy Preserving

Methods 이 논문이 사용한 방법론

VGG-19 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Privacy-Preserving Decentralized AI with Confidential Computing

2024-10-17 · Dayeol Lee, Jorge António, Hisham Khan

This paper addresses privacy protection in decentralized Artificial Intelligence (AI) using Confidential Computing (CC) within the Atoma Network, a decentralized AI platform designed for the Web3 domain. Decentralized AI…

Privacy Preserving

Efficient Privacy-Preserving Retrieval Augmented Generation with Distance-Preserving Encryption

2026-01-18 · Huanyi Ye, Jiale Guo, Ziyao Liu, Kwok-Yan Lam arxiv

RAG has emerged as a key technique for enhancing response quality of LLMs without high computational cost. In traditional architectures, RAG services are provided by a single entity that hosts the dataset within a truste…

Efficient and Verifiable Privacy-Preserving Convolutional Computation for CNN Inference with Untrusted Clouds

2025-08-18 · Jinyu Lu, Xinrong Sun, Yunting Tao, Tong Ji 외 arxiv

The widespread adoption of convolutional neural networks (CNNs) in resource-constrained scenarios has driven the development of Machine Learning as a Service (MLaaS) system. However, this approach is susceptible to priva…

Towards Privacy-Preserving Machine Translation at the Inference Stage: A New Task and Benchmark

2026-03-16 · Wei Shao, Lemao Liu, Yinqiao Li, Guoping Huang 외 arxiv

Current online translation services require sending user text to cloud servers, posing a risk of privacy leakage when the text contains sensitive information. This risk hinders the application of online translation servi…

Machine TranslationText Classification

Privacy-Preserving Machine Learning in Untrusted Clouds Made Simple

2020-09-09 · Dayeol Lee, Dmitrii Kuvaiskii, Anjo Vahldiek-Oberwagner, Mona Vij

We present a practical framework to deploy privacy-preserving machine learning (PPML) applications in untrusted clouds based on a trusted execution environment (TEE). Specifically, we shield unmodified PyTorch ML applica…

BIG-bench Machine LearningPrivacy Preserving