Towards Active Participant-Centric Vertical Federated Learning: Some Representations May Be All You Need
Vertical Federated Learning (VFL) enables collaborative model training across different participants with distinct features and common samples, while preserving data privacy. Existing VFL methodologies often struggle with realistic data partitions, typically incurring high communication costs and significant operational complexity. In this work, we introduce a novel simplified approach to VFL, Active Participant-Centric VFL (APC-VFL), that, to the best of our knowledge, is the first to require only a single communication round between participants, and allows the active participant to do inference in a non collaborative fashion. This method integrates unsupervised representation learning with knowledge distillation to achieve comparable accuracy to traditional VFL methods based on vertical split learning in classical settings, reducing required communication rounds by up to $4200\times$, while being more flexible. Our approach also shows improvements compared to non-federated local models, as well as a comparable VFL proposal, VFedTrans, offering an efficient and flexible solution for collaborative learning.
Code (0)
등록된 구현이 없습니다.
Tasks
AllFederated LearningKnowledge DistillationRepresentation LearningVertical Federated LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
VFedMH: Vertical Federated Learning for Training Multiple Heterogeneous Models
Vertical federated learning has garnered significant attention as it allows clients to train machine learning models collaboratively without sharing local data, which protects the client's local private data. However, ex…
Federated LearningVertical Federated LearningFeature Reconstruction Attacks and Countermeasures of DNN training in Vertical Federated Learning
Federated learning (FL) has increasingly been deployed, in its vertical form, among organizations to facilitate secure collaborative training over siloed data. In vertical FL (VFL), participants hold disjoint features of…
Federated LearningReconstruction AttackVertical Federated LearningMulti-Participant Multi-Class Vertical Federated Learning
Federated learning (FL) is a privacy-preserving paradigm for training collective machine learning models with locally stored data from multiple participants. Vertical federated learning (VFL) deals with the case where pa…
feature selectionFederated LearningMulti-class ClassificationMULTI-VIEW LEARNING+2VFL-RPS: Relevant Participant Selection in Vertical Federated Learning
Federated Learning (FL) allows collaboration between different parties, while ensuring that the data across these parties is not shared. However, not every collaboration is helpful in terms of the resulting model perform…
Federated LearningVertical Federated LearningThe Sherpa.ai Blind Vertical Federated Learning Paradigm to Minimize the Number of Communications
Federated Learning (FL) enables collaborative decentralized training across multiple parties (nodes) while keeping raw data private. There are two main paradigms in FL: Horizontal FL (HFL), where all participant nodes sh…
Federated Learning