Privacy-Preserving Self-Taught Federated Learning for Heterogeneous Data
Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing the data to others. Among various types of FL methods, vertical FL is a category to handle data sources with the same ID space and different feature spaces. However, existing vertical FL methods suffer from limitations such as restrictive neural network structure, slow training speed, and often lack the ability to take advantage of data with unmatched IDs. In this work, we propose an FL method called self-taught federated learning to address the aforementioned issues, which uses unsupervised feature extraction techniques for distributed supervised deep learning tasks. In this method, only latent variables are transmitted to other parties for model training, while privacy is preserved by storing the data and parameters of activations, weights, and biases locally. Extensive experiments are performed to evaluate and demonstrate the validity and efficiency of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningPrivacy PreservingSimilar Papers 제목 키워드 기반
Congruent Learning for Self-Regulated Federated Learning in 6G
Future 6G networks are expected to be AI-native with distributed machine learning functionalities responsible for improving and automating a variety of network- and service-management tasks. To enable a privacy-preservin…
Federated LearningManagementPrivacy PreservingFederated Learning on Heterogeneous and Long-Tailed Data via Classifier Re-Training with Federated Features
Federated learning (FL) provides a privacy-preserving solution for distributed machine learning tasks. One challenging problem that severely damages the performance of FL models is the co-occurrence of data heterogeneity…
Federated LearningPrivacy PreservingPersonalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMI
Heterogeneous data is endemic due to the use of diverse models and settings of devices by hospitals in the field of medical imaging. However, there are few open-source frameworks for federated heterogeneous medical image…
Medical Image AnalysisPrivacy PreservingFedPH: Privacy-enhanced Heterogeneous Federated Learning
Federated Learning is a distributed machine-learning environment that allows clients to learn collaboratively without sharing private data. This is accomplished by exchanging parameters. However, the differences in data …
Federated LearningPrivacy PreservingHHHFL: Hierarchical Heterogeneous Horizontal Federated Learning for Electroencephalography
Electroencephalography (EEG) classification techniques have been widely studied for human behavior and emotion recognition tasks. But it is still a challenging issue since the data may vary from subject to subject, may c…
EEGElectroencephalogram (EEG)Emotion RecognitionFederated Learning+2