FedKDX: Federated Learning with Negative Knowledge Distillation for Enhanced Healthcare AI Systems

2026-01-08 · Quang-Tu Pham, Hoang-Dieu Vu, Dinh-Dat Pham, Hieu H. Pham arxiv

This paper introduces FedKDX, a federated learning framework that addresses limitations in healthcare AI through Negative Knowledge Distillation (NKD). Unlike existing approaches that focus solely on positive knowledge transfer, FedKDX captures both target and non-target information to improve model generalization in healthcare applications. The framework integrates multiple knowledge transfer techniques--including traditional knowledge distillation, contrastive learning, and NKD--within a unified architecture that maintains privacy while reducing communication costs. Through experiments on healthcare datasets (SLEEP, UCI-HAR, and PAMAP2), FedKDX demonstrates improved accuracy (up to 2.53% over state-of-the-art methods), faster convergence, and better performance on non-IID data distributions. Theoretical analysis supports NKD's contribution to addressing statistical heterogeneity in distributed healthcare data. The approach shows promise for privacy-sensitive medical applications under regulatory frameworks like HIPAA and GDPR, offering a balanced solution between performance and practical implementation requirements in decentralized healthcare settings. The code and model are available at https://github.com/phamdinhdat-ai/Fed_2024.

📄 PDF Abstract BibTeX arXiv:2601.04587

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Distillation Contrastive Learning Federated Learning

FedD2S: Personalized Data-Free Federated Knowledge Distillation

2024-02-16 · Kawa Atapour, S. Jamal Seyedmohammadi, Jamshid Abouei, Arash Mohammadi 외

This paper addresses the challenge of mitigating data heterogeneity among clients within a Federated Learning (FL) framework. The model-drift issue, arising from the noniid nature of client data, often results in subopti…

Data-free Knowledge Distillation Fairness Federated Learning Knowledge Distillation+1

FedeKD: Energy-Based Gating for Robust Federated Knowledge Distillation under Heterogeneous Settings

2026-05-07 · Quang-Huy Nguyen, Jiaqi Wang, Wei-shinn Ku arxiv

Federated learning (FL) operates in heterogeneous environments, where variations in data distributions and asymmetric model design often result in negative transfer. While federated knowledge distillation (FKD) avoids di…

Knowledge Distillation Federated Learning

Evidential Federated Learning for Skin Lesion Image Classification

2024-11-15 · Rutger Hendrix, Federica Proietto Salanitri, Concetto Spampinato, Simone Palazzo 외

We introduce FedEvPrompt, a federated learning approach that integrates principles of evidential deep learning, prompt tuning, and knowledge distillation for distributed skin lesion classification. FedEvPrompt leverages …

Classification Federated Learning image-classification Image Classification+3

Selective Knowledge Sharing for Privacy-Preserving Federated Distillation without A Good Teacher

2023-04-04 · Jiawei Shao, Fangzhao Wu, Jun Zhang

While federated learning is promising for privacy-preserving collaborative learning without revealing local data, it remains vulnerable to white-box attacks and struggles to adapt to heterogeneous clients. Federated dist…

Federated Learning Knowledge Distillation Privacy Preserving Transfer Learning

FedSPLIT: One-Shot Federated Recommendation System Based on Non-negative Joint Matrix Factorization and Knowledge Distillation

2022-05-04 · Maksim E. Eren, Luke E. Richards, Manish Bhattarai, Roberto Yus 외

Non-negative matrix factorization (NMF) with missing-value completion is a well-known effective Collaborative Filtering (CF) method used to provide personalized user recommendations. However, traditional CF relies on the…

Collaborative Filtering Federated Learning Knowledge Distillation Privacy Preserving