Covert Attacks on Machine Learning Training in Passively Secure MPC
Secure multiparty computation (MPC) allows data owners to train machine learning models on combined data while keeping the underlying training data private. The MPC threat model either considers an adversary who passively corrupts some parties without affecting their overall behavior, or an adversary who actively modifies the behavior of corrupt parties. It has been argued that in some settings, active security is not a major concern, partly because of the potential risk of reputation loss if a party is detected cheating. In this work we show explicit, simple, and effective attacks that an active adversary can run on existing passively secure MPC training protocols, while keeping essentially zero risk of the attack being detected. The attacks we show can compromise both the integrity and privacy of the model, including attacks reconstructing exact training data. Our results challenge the belief that a threat model that does not include malicious behavior by the involved parties may be reasonable in the context of PPML, motivating the use of actively secure protocols for training.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DNS Covert Channel Detection via Behavioral Analysis: a Machine Learning Approach
Detecting covert channels among legitimate traffic represents a severe challenge due to the high heterogeneity of networks. Therefore, we propose an effective covert channel detection method, based on the analysis of DNS…
BIG-bench Machine LearningTrojanPuzzle: Covertly Poisoning Code-Suggestion Models
With tools like GitHub Copilot, automatic code suggestion is no longer a dream in software engineering. These tools, based on large language models, are typically trained on massive corpora of code mined from unvetted pu…
Data PoisoningA Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks
This paper presents a secure reinforcement learning (RL) based control method for unknown linear time-invariant cyber-physical systems (CPSs) that are subjected to compositional attacks such as eavesdropping and covert a…
Misinformationreinforcement-learningReinforcement LearningReinforcement Learning (RL)Asymptotic Security of Control Systems by Covert Reaction: Repeated Signaling Game with Undisclosed Belief
This study investigates the relationship between resilience of control systems to attacks and the information available to malicious attackers. Specifically, it is shown that control systems are guaranteed to be secure i…
Secure Transmission with Different Security Requirements Based on Covert Communication and Information-Theoretic Security in Presence of Friendly Jammer
In this paper, we investigate joint information-theoretic security and covert communication on a network in the presence of a single transmitter (Alice), a friendly jammer, a single untrusted user, two legitimate users, …