SplitFedZip: Learned Compression for Data Transfer Reduction in Split-Federated Learning
Federated Learning (FL) enables multiple clients to train a collaborative model without sharing their local data. Split Learning (SL) allows a model to be trained in a split manner across different locations. Split-Federated (SplitFed) learning is a more recent approach that combines the strengths of FL and SL. SplitFed minimizes the computational burden of FL by balancing computation across clients and servers, while still preserving data privacy. This makes it an ideal learning framework across various domains, especially in healthcare, where data privacy is of utmost importance. However, SplitFed networks encounter numerous communication challenges, such as latency, bandwidth constraints, synchronization overhead, and a large amount of data that needs to be transferred during the learning process. In this paper, we propose SplitFedZip -- a novel method that employs learned compression to reduce data transfer in SplitFed learning. Through experiments on medical image segmentation, we show that learned compression can provide a significant data communication reduction in SplitFed learning, while maintaining the accuracy of the final trained model. The implementation is available at: \url{https://github.com/ChamaniS/SplitFedZip}.
Code (1)
Tasks
Federated LearningImage SegmentationMedical Image SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Efficient Neural Network Compression via Transfer Learning for Industrial Optical Inspection
In this paper, we investigate learning the deep neural networks for automated optical inspection in industrial manufacturing. Our preliminary result has shown the stunning performance improvement by transfer learning fro…
Neural Network CompressionTransfer LearningNeural Embedding Compression For Efficient Multi-Task Earth Observation Modelling
As repositories of large scale data in earth observation (EO) have grown, so have transfer and storage costs for model training and inference, expending significant resources. We introduce Neural Embedding Compression (N…
Earth ObservationScene ClassificationSemantic SegmentationLearned Compression for Images and Point Clouds
Over the last decade, deep learning has shown great success at performing computer vision tasks, including classification, super-resolution, and style transfer. Now, we apply it to data compression to help build the next…
Data CompressionStyle TransferSuper-ResolutionCompression Artifacts Reduction by a Deep Convolutional Network
Lossy compression introduces complex compression artifacts, particularly the blocking artifacts, ringing effects and blurring. Existing algorithms either focus on removing blocking artifacts and produce blurred output, o…
BlockingDenoisingJPEG Artifact CorrectionTransfer LearningTransferable Learned Image Compression-Resistant Adversarial Perturbations
Adversarial attacks can readily disrupt the image classification system, revealing the vulnerability of DNN-based recognition tasks. While existing adversarial perturbations are primarily applied to uncompressed images o…
Adversarial AttackAutonomous DrivingClassificationFace Recognition+3