Privacy-Preserving Hierarchical Model-Distributed Inference
This paper focuses on designing a privacy-preserving Machine Learning (ML) inference protocol for a hierarchical setup, where clients own/generate data, model owners (cloud servers) have a pre-trained ML model, and edge servers perform ML inference on clients' data using the cloud server's ML model. Our goal is to speed up ML inference while providing privacy to both data and the ML model. Our approach (i) uses model-distributed inference (model parallelization) at the edge servers and (ii) reduces the amount of communication to/from the cloud server. Our privacy-preserving hierarchical model-distributed inference, privateMDI design uses additive secret sharing and linearly homomorphic encryption to handle linear calculations in the ML inference, and garbled circuit and a novel three-party oblivious transfer are used to handle non-linear functions. privateMDI consists of offline and online phases. We designed these phases in a way that most of the data exchange is done in the offline phase while the communication overhead of the online phase is reduced. In particular, there is no communication to/from the cloud server in the online phase, and the amount of communication between the client and edge servers is minimized. The experimental results demonstrate that privateMDI significantly reduces the ML inference time as compared to the baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
modelPrivacy PreservingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Privacy-Preserving Cloud Architecture for Distributed Machine Learning at Scale
Distributed machine learning systems require strong privacy guarantees, verifiable compliance, and scalable deployment across heterogeneous and multi-cloud environments. This work introduces a cloud-native privacy-preser…
Reinforcement LearningFederated LearningEdgePrompt: A Distributed Key-Value Inference Framework for LLMs in 6G Networks
As sixth-generation (6G) networks advance, large language models (LLMs) are increasingly integrated into 6G infrastructure to enhance network management and intelligence. However, traditional LLMs architecture struggle t…
ManagementPrivacy PreservingSynergising Hierarchical Data Centers and Power Networks: A Privacy-Preserving Approach
In the era of digitization, data centers have emerged as integral contributors sustaining our interlinked world, bearing responsibility for an increasing proportion of the world's energy consumption. To facilitate the th…
Privacy PreservingPrivacy-Preserving Distributed Learning in IoT Systems: A Unified Threat Model and Evaluation Framework
The increasing deployment of Internet-of-Things (IoT) devices has accelerated the use of distributed learning frameworks, where data remains local while model updates are shared across decentralized systems. Although thi…
Secure Byzantine-Robust Distributed Learning via Clustering
Federated learning systems that jointly preserve Byzantine robustness and privacy have remained an open problem. Robust aggregation, the standard defense for Byzantine attacks, generally requires server access to individ…
ClusteringFederated LearningPrivacy Preserving