TreeCSS: An Efficient Framework for Vertical Federated Learning
Vertical federated learning (VFL) considers the case that the features of data samples are partitioned over different participants. VFL consists of two main steps, i.e., identify the common data samples for all participants (alignment) and train model using the aligned data samples (training). However, when there are many participants and data samples, both alignment and training become slow. As such, we propose TreeCSS as an efficient VFL framework that accelerates the two main steps. In particular, for sample alignment, we design an efficient multi-party private set intersection (MPSI) protocol called Tree-MPSI, which adopts a tree-based structure and a data-volume-aware scheduling strategy to parallelize alignment among the participants. As model training time scales with the number of data samples, we conduct coreset selection (CSS) to choose some representative data samples for training. Our CCS method adopts a clustering-based scheme for security and generality, which first clusters the features locally on each participant and then merges the local clustering results to select representative samples. In addition, we weight the samples according to their distances to the centroids to reflect their importance to model training. We evaluate the effectiveness and efficiency of our TreeCSS framework on various datasets and models. The results show that compared with vanilla VFL, TreeCSS accelerates training by up to 2.93x and achieves comparable model accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringFederated LearningSchedulingVertical Federated LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Vertical Federated Learning Framework for Horizontally Partitioned Labels
Vertical federated learning is a collaborative machine learning framework to train deep leaning models on vertically partitioned data with privacy-preservation. It attracts much attention both from academia and industry.…
Federated LearningVertical Federated LearningPyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN
We introduce PyVertical, a framework supporting vertical federated learning using split neural networks. The proposed framework allows a data scientist to train neural networks on data features vertically partitioned acr…
Federated LearningVertical Federated LearningA Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression
Data privacy and security becomes a major concern in building machine learning models from different data providers. Federated learning shows promise by leaving data at providers locally and exchanging encrypted informat…
Federated LearningregressionVertical Federated LearningQuadratic Functional Encryption for Secure Training in Vertical Federated Learning
Vertical federated learning (VFL) enables the collaborative training of machine learning (ML) models in settings where the data is distributed amongst multiple parties who wish to protect the privacy of their individual …
Federated LearningVertical Federated LearningA Novel Framework of Horizontal-Vertical Hybrid Federated Learning for EdgeIoT
This letter puts forth a new hybrid horizontal-vertical federated learning (HoVeFL) for mobile edge computing-enabled Internet of Things (EdgeIoT). In this framework, certain EdgeIoT devices train local models using the …
Edge-computingFederated LearningVertical Federated Learning