paper-with-me

홈 › Papers

SWIFT: Super-fast and Robust Privacy-Preserving Machine Learning

2020-05-20 · Nishat Koti, Mahak Pancholi, Arpita Patra, Ajith Suresh

Performing machine learning (ML) computation on private data while maintaining data privacy, aka Privacy-preserving Machine Learning~(PPML), is an emergent field of research. Recently, PPML has seen a visible shift towards the adoption of the Secure Outsourced Computation~(SOC) paradigm due to the heavy computation that it entails. In the SOC paradigm, computation is outsourced to a set of powerful and specially equipped servers that provide service on a pay-per-use basis. In this work, we propose SWIFT, a robust PPML framework for a range of ML algorithms in SOC setting, that guarantees output delivery to the users irrespective of any adversarial behaviour. Robustness, a highly desirable feature, evokes user participation without the fear of denial of service. At the heart of our framework lies a highly-efficient, maliciously-secure, three-party computation (3PC) over rings that provides guaranteed output delivery (GOD) in the honest-majority setting. To the best of our knowledge, SWIFT is the first robust and efficient PPML framework in the 3PC setting. SWIFT is as fast as (and is strictly better in some cases than) the best-known 3PC framework BLAZE (Patra et al. NDSS'20), which only achieves fairness. We extend our 3PC framework for four parties (4PC). In this regime, SWIFT is as fast as the best known fair 4PC framework Trident (Chaudhari et al. NDSS'20) and twice faster than the best-known robust 4PC framework FLASH (Byali et al. PETS'20). We demonstrate our framework's practical relevance by benchmarking popular ML algorithms such as Logistic Regression and deep Neural Networks such as VGG16 and LeNet, both over a 64-bit ring in a WAN setting. For deep NN, our results testify to our claims that we provide improved security guarantee while incurring no additional overhead for 3PC and obtaining 2x improvement for 4PC.

📄 PDF Abstract BibTeX arXiv:2005.10296

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingBIG-bench Machine LearningFairnessPrivacy Preserving

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Privacy-Preserving Transformers: SwiftKey's Differential Privacy Implementation

2025-05-08 · Abdelrahman Abouelenin, Mohamed Abdelrehim, Raffy Fahim, Amr Hendy 외

In this paper we train a transformer using differential privacy (DP) for language modeling in SwiftKey. We run multiple experiments to balance the trade-off between the model size, run-time speed and accuracy. We show th…

Language ModelingLanguage ModellingPrivacy Preserving

SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation

2024-10-04 · Aurick Qiao, Zhewei Yao, Samyam Rajbhandari, Yuxiong He

LLM inference for popular enterprise use cases, such as summarization, RAG, and code-generation, typically observes orders of magnitude longer prompt lengths than generation lengths. This characteristic leads to high cos…

16kCode GenerationGPURAG

Efficient Sparse Least Absolute Deviation Regression with Differential Privacy

2024-01-02 · Weidong Liu, Xiaojun Mao, Xiaofei Zhang, Xin Zhang

In recent years, privacy-preserving machine learning algorithms have attracted increasing attention because of their important applications in many scientific fields. However, in the literature, most privacy-preserving a…

Privacy Preservingregression

SwiftAgg+: Achieving Asymptotically Optimal Communication Loads in Secure Aggregation for Federated Learning

2022-03-24 · Tayyebeh Jahani-Nezhad, Mohammad Ali Maddah-Ali, Songze Li, Giuseppe Caire

We propose SwiftAgg+, a novel secure aggregation protocol for federated learning systems, where a central server aggregates local models of $N \in \mathbb{N}$ distributed users, each of size $L \in \mathbb{N}$, trained o…

Federated LearningPrivacy Preserving

CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU

2021-04-22 · Sijun Tan, Brian Knott, Yuan Tian, David J. Wu

We introduce CryptGPU, a system for privacy-preserving machine learning that implements all operations on the GPU (graphics processing unit). Just as GPUs played a pivotal role in the success of modern deep learning, the…

BIG-bench Machine LearningCPUGPUPrivacy Preserving+1