paper-with-me

홈 › Papers

Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data

2024-03-06 · Avi Amalanshu, Yash Sirvi, David I. Inouye

Vertical Federated Learning (VFL) is an emergent distributed machine learning paradigm for collaborative learning between clients who have disjoint features of common entities. However, standard VFL lacks fault tolerance, with each participant and connection being a single point of failure. Prior attempts to induce fault tolerance in VFL focus on the scenario of "straggling clients", usually entailing that all messages eventually arrive or that there is an upper bound on the number of late messages. To handle the more general problem of arbitrary crashes, we propose Decoupled VFL (DVFL). To handle training with faults, DVFL decouples training between communication rounds using local unsupervised objectives. By further decoupling label supervision from aggregation, DVFL also enables redundant aggregators. As secondary benefits, DVFL can enhance data efficiency and provides immunity against gradient-based attacks. In this work, we implement DVFL for split neural networks with a self-supervised autoencoder loss. When there are faults, DVFL outperforms the best VFL-based alternative (97.58% vs 96.95% on an MNIST task). Even under perfect conditions, performance is comparable.

📄 PDF Abstract BibTeX arXiv:2403.03871

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningVertical Federated Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning

2020-08-14 · Bin Gu, An Xu, Zhouyuan Huo, Cheng Deng 외

The privacy-preserving federated learning for vertically partitioned data has shown promising results as the solution of the emerging multi-party joint modeling application, in which the data holders (such as government …

Federated LearningPrivacy Preserving

An Efficient and Robust System for Vertically Federated Random Forest

2022-01-26 · Houpu Yao, Jiazhou Wang, Peng Dai, Liefeng Bo 외

As there is a growing interest in utilizing data across multiple resources to build better machine learning models, many vertically federated learning algorithms have been proposed to preserve the data privacy of the par…

Federated Learning

PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN

2021-04-01 · Daniele Romanini, Adam James Hall, Pavlos Papadopoulos, Tom Titcombe 외

We introduce PyVertical, a framework supporting vertical federated learning using split neural networks. The proposed framework allows a data scientist to train neural networks on data features vertically partitioned acr…

Federated LearningVertical Federated Learning

Confederated Machine Learning on Horizontally and Vertically Separated Medical Data for Large-Scale Health System Intelligence

2019-10-04 · ICLR 2020 1 · Dianbo Liu, Kathe Fox, Griffin Weber, Tim Miller

Health information is generally fragmented across silos. Though it is technically feasible to unite data for analysis in a manner that underpins a rapid learning healthcare system, privacy concerns and regulatory barrier…

BIG-bench Machine LearningFederated Learning

Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data

2022-03-03 · Yiu-ming Cheung, Juyong Jiang, Feng Yu, Jian Lou

Despite enormous research interest and rapid application of federated learning (FL) to various areas, existing studies mostly focus on supervised federated learning under the horizontally partitioned local dataset settin…

Dimensionality ReductionFederated Learning