Mutual Information Regularization for Vertical Federated Learning
Vertical Federated Learning (VFL) is widely utilized in real-world applications to enable collaborative learning while protecting data privacy and safety. However, previous works show that parties without labels (passive parties) in VFL can infer the sensitive label information owned by the party with labels (active party) or execute backdoor attacks to VFL. Meanwhile, active party can also infer sensitive feature information from passive party. All these pose new privacy and security challenges to VFL systems. We propose a new general defense method which limits the mutual information between private raw data, including both features and labels, and intermediate outputs to achieve a better trade-off between model utility and privacy. We term this defense Mutual Information Regularization Defense (MID). We theoretically and experimentally testify the effectiveness of our MID method in defending existing attacks in VFL, including label inference attacks, backdoor attacks and feature reconstruction attacks.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningVertical Federated LearningSimilar Papers 제목 키워드 기반
Eliminating Label Leakage in Tree-Based Vertical Federated Learning
Vertical federated learning (VFL) enables multiple parties with disjoint features of a common user set to train a machine learning model without sharing their private data. Tree-based models have become prevalent in VFL …
Federated LearningInference AttackVertical Federated LearningRevisiting Label Inference Attacks in Vertical Federated Learning: Why They Are Vulnerable and How to Defend
Vertical federated learning (VFL) allows an active party with a top model, and multiple passive parties with bottom models to collaborate. In this scenario, passive parties possessing only features may attempt to infer a…
Federated LearningBatch Label Inference and Replacement Attacks in Black-Boxed Vertical Federated Learning
In a vertical federated learning (VFL) scenario where features and model are split into different parties, communications of sample-specific updates are required for correct gradient calculations but can be used to deduc…
Federated LearningInference AttackVertical Federated LearningDefending against Reconstruction Attack in Vertical Federated Learning
Recently researchers have studied input leakage problems in Federated Learning (FL) where a malicious party can reconstruct sensitive training inputs provided by users from shared gradient. It raises concerns about FL si…
Federated LearningPrivacy PreservingReconstruction AttackVertical Federated LearningVertical Federated Linear Contextual Bandits
In this paper, we investigate a novel problem of building contextual bandits in the vertical federated setting, i.e., contextual information is vertically distributed over different departments. This problem remains larg…
Multi-Armed Bandits