GAN-based Vertical Federated Learning for Label Protection in Binary Classification
Split learning (splitNN) has emerged as a popular strategy for addressing the high computational costs and low modeling efficiency in Vertical Federated Learning (VFL). However, despite its popularity, vanilla splitNN lacks encryption protection, leaving it vulnerable to privacy leakage issues, especially Label Leakage from Gradients (LLG). Motivated by the LLG issue resulting from the use of labels during training, we propose the Generative Adversarial Federated Model (GAFM), a novel method designed specifically to enhance label privacy protection by integrating splitNN with Generative Adversarial Networks (GANs). GAFM leverages GANs to indirectly utilize label information by learning the label distribution rather than relying on explicit labels, thereby mitigating LLG. GAFM also employs an additional cross-entropy loss based on the noisy labels to further improve the prediction accuracy. Our ablation experiment demonstrates that the combination of GAN and the cross-entropy loss component is necessary to enable GAFM to mitigate LLG without significantly compromising the model utility. Empirical results on various datasets show that GAFM achieves a better and more robust trade-off between model utility and privacy compared to all baselines across multiple random runs. In addition, we provide experimental justification to substantiate GAFM's superiority over splitNN, demonstrating that it offers enhanced label protection through gradient perturbation relative to splitNN.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationFederated LearningVertical Federated LearningSimilar Papers 제목 키워드 기반
Feature Reconstruction Attacks and Countermeasures of DNN training in Vertical Federated Learning
Federated learning (FL) has increasingly been deployed, in its vertical form, among organizations to facilitate secure collaborative training over siloed data. In vertical FL (VFL), participants hold disjoint features of…
Federated LearningReconstruction AttackVertical Federated LearningResidue-based Label Protection Mechanisms in Vertical Logistic Regression
Federated learning (FL) enables distributed participants to collaboratively learn a global model without revealing their private data to each other. Recently, vertical FL, where the participants hold the same set of samp…
Federated LearningInference AttackregressionMulti-Participant Multi-Class Vertical Federated Learning
Federated learning (FL) is a privacy-preserving paradigm for training collective machine learning models with locally stored data from multiple participants. Vertical federated learning (VFL) deals with the case where pa…
feature selectionFederated LearningMulti-class ClassificationMULTI-VIEW LEARNING+2A Framework for Evaluating Privacy-Utility Trade-off in Vertical Federated Learning
Federated learning (FL) has emerged as a practical solution to tackle data silo issues without compromising user privacy. One of its variants, vertical federated learning (VFL), has recently gained increasing attention a…
Federated LearningPrivacy PreservingVertical Federated LearningAsymmetrical Vertical Federated Learning
Federated learning is a distributed machine learning method that aims to preserve the privacy of sample features and labels. In a federated learning system, ID-based sample alignment approaches are usually applied with f…
Federated LearningVertical Federated Learning