Vertical Semi-Federated Learning for Efficient Online Advertising
The traditional vertical federated learning schema suffers from two main issues: 1) restricted applicable scope to overlapped samples and 2) high system challenge of real-time federated serving, which limits its application to advertising systems. To this end, we advocate a new learning setting Semi-VFL (Vertical Semi-Federated Learning) to tackle these challenge. Semi-VFL is proposed to achieve a practical industry application fashion for VFL, by learning a federation-aware local model which performs better than single-party models and meanwhile maintain the convenience of local-serving. For this purpose, we propose the carefully designed Joint Privileged Learning framework (JPL) to i) alleviate the absence of the passive party's feature and ii) adapt to the whole sample space. Specifically, we build an inference-efficient single-party student model applicable to the whole sample space and meanwhile maintain the advantage of the federated feature extension. New representation distillation methods are designed to extract cross-party feature correlations for both the overlapped and non-overlapped data. We conducted extensive experiments on real-world advertising datasets. The results show that our method achieves the best performance over baseline methods and validate its superiority in the Semi-VFL setting.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningVertical Federated LearningSimilar Papers 제목 키워드 기반
VFed-SSD: Towards Practical Vertical Federated Advertising
As an emerging secure learning paradigm in lever-aging cross-agency private data, vertical federatedlearning (VFL) is expected to improve advertising models by enabling the joint learning of complementary user attributes…
Federated LearningKnowledge DistillationTransfer LearningDefending against Reconstruction Attack in Vertical Federated Learning
Recently researchers have studied input leakage problems in Federated Learning (FL) where a malicious party can reconstruct sensitive training inputs provided by users from shared gradient. It raises concerns about FL si…
Federated LearningPrivacy PreservingReconstruction AttackVertical Federated LearningVertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data
Despite enormous research interest and rapid application of federated learning (FL) to various areas, existing studies mostly focus on supervised federated learning under the horizontally partitioned local dataset settin…
Dimensionality ReductionFederated LearningFedAds: A Benchmark for Privacy-Preserving CVR Estimation with Vertical Federated Learning
Conversion rate (CVR) estimation aims to predict the probability of conversion event after a user has clicked an ad. Typically, online publisher has user browsing interests and click feedbacks, while demand-side advertis…
Federated LearningPrivacy PreservingVertical Federated LearningFederated Doubly Stochastic Kernel Learning for Vertically Partitioned Data
In a lot of real-world data mining and machine learning applications, data are provided by multiple providers and each maintains private records of different feature sets about common entities. It is challenging to train…
BIG-bench Machine LearningFederated Learning