paper-with-me

홈 › Papers

Practical Vertical Federated Learning with Unsupervised Representation Learning

2022-08-13 · Zhaomin Wu, Qinbin Li, Bingsheng He

As societal concerns on data privacy recently increase, we have witnessed data silos among multiple parties in various applications. Federated learning emerges as a new learning paradigm that enables multiple parties to collaboratively train a machine learning model without sharing their raw data. Vertical federated learning, where each party owns different features of the same set of samples and only a single party has the label, is an important and challenging topic in federated learning. Communication costs among different parties have been a major hurdle for practical vertical learning systems. In this paper, we propose a novel communication-efficient vertical federated learning algorithm named FedOnce, which requires only one-shot communication among parties. To improve model accuracy and provide privacy guarantee, FedOnce features unsupervised learning representations in the federated setting and privacy-preserving techniques based on moments accountant. The comprehensive experiments on 10 datasets demonstrate that FedOnce achieves close performance compared to state-of-the-art vertical federated learning algorithms with much lower communication costs. Meanwhile, our privacy-preserving technique significantly outperforms the state-of-the-art approaches under the same privacy budget.

📄 PDF Abstract BibTeX arXiv:2208.10278

Code (1)

jerrylife/fedonce 공식 구현 pytorch

Tasks

Federated LearningPrivacy PreservingRepresentation LearningVertical Federated Learning

Similar Papers 제목 키워드 기반

Towards Active Participant-Centric Vertical Federated Learning: Some Representations May Be All You Need

2024-10-23 · Jon Irureta, Jon Imaz, Aizea Lojo, Marco González 외

Vertical Federated Learning (VFL) enables collaborative model training across different participants with distinct features and common samples, while preserving data privacy. Existing VFL methodologies often struggle wit…

AllFederated LearningKnowledge DistillationRepresentation Learning+1

FedLED: Label-Free Equipment Fault Diagnosis with Vertical Federated Transfer Learning

2023-12-29 · Jie Shen, Shusen Yang, Cong Zhao, Xuebin Ren 외

Intelligent equipment fault diagnosis based on Federated Transfer Learning (FTL) attracts considerable attention from both academia and industry. It allows real-world industrial agents with limited samples to construct a…

Fault DiagnosisTransfer Learning

Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data

2024-03-06 · Avi Amalanshu, Yash Sirvi, David I. Inouye

Vertical Federated Learning (VFL) is an emergent distributed machine learning paradigm for collaborative learning between clients who have disjoint features of common entities. However, standard VFL lacks fault tolerance…

Federated LearningVertical Federated Learning

Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data

2022-03-03 · Yiu-ming Cheung, Juyong Jiang, Feng Yu, Jian Lou

Despite enormous research interest and rapid application of federated learning (FL) to various areas, existing studies mostly focus on supervised federated learning under the horizontally partitioned local dataset settin…

Dimensionality ReductionFederated Learning

Vertical Semi-Federated Learning for Efficient Online Advertising

2022-09-30 · Wenjie Li, Qiaolin Xia, Hao Cheng, Kouyin Xue 외

The traditional vertical federated learning schema suffers from two main issues: 1) restricted applicable scope to overlapped samples and 2) high system challenge of real-time federated serving, which limits its applicat…

Federated LearningVertical Federated Learning