OpBoost: A Vertical Federated Tree Boosting Framework Based on Order-Preserving Desensitization
Vertical Federated Learning (FL) is a new paradigm that enables users with non-overlapping attributes of the same data samples to jointly train a model without directly sharing the raw data. Nevertheless, recent works show that it's still not sufficient to prevent privacy leakage from the training process or the trained model. This paper focuses on studying the privacy-preserving tree boosting algorithms under the vertical FL. The existing solutions based on cryptography involve heavy computation and communication overhead and are vulnerable to inference attacks. Although the solution based on Local Differential Privacy (LDP) addresses the above problems, it leads to the low accuracy of the trained model. This paper explores to improve the accuracy of the widely deployed tree boosting algorithms satisfying differential privacy under vertical FL. Specifically, we introduce a framework called OpBoost. Three order-preserving desensitization algorithms satisfying a variant of LDP called distance-based LDP (dLDP) are designed to desensitize the training data. In particular, we optimize the dLDP definition and study efficient sampling distributions to further improve the accuracy and efficiency of the proposed algorithms. The proposed algorithms provide a trade-off between the privacy of pairs with large distance and the utility of desensitized values. Comprehensive evaluations show that OpBoost has a better performance on prediction accuracy of trained models compared with existing LDP approaches on reasonable settings. Our code is open source.
Code (1)
Tasks
Federated LearningPrivacy PreservingVertical Federated LearningSimilar Papers 제목 키워드 기반
FedGBF: An efficient vertical federated learning framework via gradient boosting and bagging
Federated learning, conducive to solving data privacy and security problems, has attracted increasing attention recently. However, the existing federated boosting model sequentially builds a decision tree model with the …
Federated LearningVertical Federated LearningSecureBoost+: Large Scale and High-Performance Vertical Federated Gradient Boosting Decision Tree
Gradient boosting decision tree (GBDT) is an ensemble machine learning algorithm, which is widely used in industry, due to its good performance and easy interpretation. Due to the problem of data isolation and the requir…
Federated LearningPrivacy PreservingVertical Federated LearningFed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Federated Learning
The increasing concerns about data privacy and security drive an emerging field of studying privacy-preserving machine learning from isolated data sources, i.e., federated learning. A class of federated learning, vertica…
BIG-bench Machine LearningFederated LearningPrivacy PreservingVertical Federated LearningPrivacy Preserving Vertical Federated Learning for Tree-based Models
Federated learning (FL) is an emerging paradigm that enables multiple organizations to jointly train a model without revealing their private data to each other. This paper studies {\it vertical} federated learning, which…
Federated LearningPrivacy PreservingVertical Federated LearningSecureBoost: A Lossless Federated Learning Framework
The protection of user privacy is an important concern in machine learning, as evidenced by the rolling out of the General Data Protection Regulation (GDPR) in the European Union (EU) in May 2018. The GDPR is designed to…
BIG-bench Machine LearningEntity AlignmentFederated LearningPrivacy Preserving