paper-with-me

홈 › Papers

Decentralized Gossip Mutual Learning (GML) for automatic head and neck tumor segmentation

2024-01-11 · Jingyun Chen, Yading Yuan

Federated learning (FL) has emerged as a promising strategy for collaboratively training complicated machine learning models from different medical centers without the need of data sharing. However, the traditional FL relies on a central server to orchestrate the global model training among clients. This makes it vulnerable to the failure of the model server. Meanwhile, the model trained based on the global data property may not yield the best performance on the local data of a particular site due to the variations of data characteristics among them. To address these limitations, we proposed Gossip Mutual Learning(GML), a decentralized collaborative learning framework that employs Gossip Protocol for direct peer-to-peer communication and encourages each site to optimize its local model by leveraging useful information from peers through mutual learning. On the task of tumor segmentation on PET/CT images using HECKTOR21 dataset with 223 cases from five clinical sites, we demonstrated GML could improve tumor segmentation performance in terms of Dice Similarity Coefficient (DSC) by 3.2%, 4.6% and 10.4% on site-specific testing cases as compared to three baseline methods: pooled training, FedAvg and individual training, respectively. We also showed GML has comparable generalization performance as pooled training and FedAvg when applying them on 78 cases from two out-of-sample sites where no case was used for model training. In our experimental setup, GML showcased a sixfold decrease in communication overhead compared to FedAvg, requiring only 16.67% of the total communication overhead.

📄 PDF Abstract BibTeX arXiv:2401.06180

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningTumor Segmentation

Similar Papers 제목 키워드 기반

Decentralized Gossip Mutual Learning (GML) for brain tumor segmentation on multi-parametric MRI

2024-01-27 · Jingyun Chen, Yading Yuan

Federated Learning (FL) enables collaborative model training among medical centers without sharing private data. However, traditional FL risks on server failures and suboptimal performance on local data due to the nature…

Brain Tumor SegmentationFederated LearningTumor Segmentation

An asynchronous distributed training algorithm based on Gossip

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Distributed training is widely used in deep learning, and distributed method is divided into centralized and decentralized. Centralized distributed clusters, such as Parameter Server (PS), have been widely used nowadays.…

SeedFlood: A Step Toward Scalable Decentralized Training of LLMs

2026-02-20 · Jihun Kim, Namhoon Lee arxiv

This work presents a new approach to decentralized training-SeedFlood-designed to scale for large models across complex network topologies and achieve global consensus with minimal communication overhead. Traditional gos…

AdaGossip: Adaptive Consensus Step-size for Decentralized Deep Learning with Communication Compression

2024-04-09 · Sai Aparna Aketi, Abolfazl Hashemi, Kaushik Roy

Decentralized learning is crucial in supporting on-device learning over large distributed datasets, eliminating the need for a central server. However, the communication overhead remains a major bottleneck for the practi…

Event-Triggered Gossip for Distributed Learning

2026-02-22 · Zhiyuan Zhai, Xiaojun Yuan, Wei Ni, Xin Wang 외 arxiv

While distributed learning offers a new learning paradigm for distributed network with no central coordination, it is constrained by communication bottleneck between nodes. We develop a new event-triggered gossip framewo…