BiFedKD: Bidirectional Federated Knowledge Distillation Framework for Non-IID and Long-Tailed ECG Monitoring

2026-05-14 · Zixuan Shu, Tiancheng Cao, Hen-Wei Huang arxiv

Electrocardiogram (ECG) monitoring in Internet of Medical Things (IoMT) networks is constrained by strict data-sharing regulations and privacy concerns. Federated learning (FL) enables collaborative learning by keeping raw ECG data on devices, but frequent transmissions of high-dimensional model updates incur heavy per-round traffic over bandwidth-limited links. To alleviate this bottleneck, federated distillation (FD) replaces parameter exchange with logit-based knowledge transfer. However, the performance of FD often degrades under the non-independent and identically distributed (non-IID) and long-tailed label distributions in ECG deployments. To address these challenges, we propose a bidirectional federated knowledge distillation (BiFedKD) framework that employs an aggregation-by-distillation pipeline with temperature scaling to produce a stable global distillation signal for cross-client alignment. Experiments on the MIT-BIH Arrhythmia dataset show that BiFedKD improves accuracy and Macro-F1 over the baseline by $3.52\%$ and $9.93\%$, respectively. Moreover, to reach the same Macro-F1, BiFedKD reduces communication overhead by $40\%$ and computation cost by $71.7\%$ compared with the baseline.

📄 PDF Abstract BibTeX arXiv:2605.14886

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Distillation Federated Learning

Federated Reasoning Distillation Framework with Model Learnability-Aware Data Allocation

2026-02-21 · Wei Guo, Siyuan Lu, Xiangdong Ran, Yiqi Tong 외 arxiv

Data allocation plays a critical role in federated large language model (LLM) and small language models (SLMs) reasoning collaboration. Nevertheless, existing data allocation methods fail to address an under-explored cha…

Heterogeneous Federated Learning Using Knowledge Codistillation

2023-10-04 · Jared Lichtarge, Ehsan Amid, Shankar Kumar, Tien-Ju Yang 외

Federated Averaging, and many federated learning algorithm variants which build upon it, have a limitation: all clients must share the same model architecture. This results in unused modeling capacity on many clients, wh…

Federated Learning image-classification Image Classification Knowledge Distillation+2

FedBKD: Distilled Federated Learning to Embrace Gerneralization and Personalization on Non-IID Data

2025-06-25 · Yushan Zhao, Jinyuan He, Donglai Chen, Weijie Luo 외

Federated learning (FL) is a decentralized collaborative machine learning (ML) technique. It provides a solution to the issues of isolated data islands and data privacy leakage in industrial ML practices. One major chall…

Federated Learning Knowledge Distillation

FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization

2025-05-05 · Hongze Li, Zesheng Zhou, Zhenbiao Cao, Xinhui Li 외

Traditional domain generalization approaches predominantly focus on leveraging target domain-aware features while overlooking the critical role of source domain-specific characteristics, particularly in federated setting…

Domain Generalization Knowledge Distillation

Sentinel: Dynamic Knowledge Distillation for Personalized Federated Intrusion Detection in Heterogeneous IoT Networks

2025-10-27 · Gurpreet Singh, Keshav Sood, P. Rajalakshmi, Yong Xiang arxiv

Federated learning (FL) offers a privacy-preserving paradigm for machine learning, but its application in intrusion detection systems (IDS) within IoT networks is challenged by severe class imbalance, non-IID data, and h…

Knowledge Distillation Intrusion Detection Federated Learning