Domain-Skewed Federated Learning with Feature Decoupling and Calibration

2026-03-15 · Huan Wang, Jun Shen, Jun Yan, Guansong Pang arxiv

Federated learning (FL) allows distributed clients to collaboratively train a global model in a privacy-preserving manner. However, one major challenge is domain skew, where clients' data originating from diverse domains may hinder the aggregated global model from learning a consistent representation space, resulting in poor generalizable ability in multiple domains. In this paper, we argue that the domain skew is reflected in the domain-specific biased features of each client, causing the local model's representations to collapse into a narrow low-dimensional subspace. We then propose Federated Feature Decoupling and Calibration ($F^2$DC), which liberates valuable class-relevant information by calibrating the domain-specific biased features, enabling more consistent representations across domains. A novel component, Domain Feature Decoupler (DFD), is first introduced in $F^2$DC to determine the robustness of each feature unit, thereby separating the local features into domain-robust features and domain-related features. A Domain Feature Corrector (DFC) is further proposed to calibrate these domain-related features by explicitly linking discriminative signals, capturing additional class-relevant clues that complement the domain-robust features. Finally, a domain-aware aggregation of the local models is performed to promote consensus among clients. Empirical results on three popular multi-domain datasets demonstrate the effectiveness of the proposed $F^2$DC and the contributions of its two modules. Code is available at https://github.com/mala-lab/F2DC.

📄 PDF Abstract BibTeX arXiv:2603.14238

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Geometric Prior-Guided Federated Prompt Calibration

2025-12-08 · Fei Luo, Ziwei Zhao, Mingxuan Wang, Duoyang Li 외 arxiv

Federated Prompt Learning (FPL) offers a parameter-efficient solution for collaboratively training large models, but its performance is severely hindered by data heterogeneity, which causes locally trained prompts to bec…

FedHCDR: Federated Cross-Domain Recommendation with Hypergraph Signal Decoupling

2024-03-05 · Hongyu Zhang, Dongyi Zheng, Lin Zhong, Xu Yang 외

In recent years, Cross-Domain Recommendation (CDR) has drawn significant attention, which utilizes user data from multiple domains to enhance the recommendation performance. However, current CDR methods require sharing u…

Contrastive Learning Data Augmentation Federated Learning Graph Learning+5

Federated Unlearning Model Recovery in Data with Skewed Label Distributions

2024-12-18 · Xinrui Yu, Wenbin Pei, Bing Xue, Qiang Zhang

In federated learning, federated unlearning is a technique that provides clients with a rollback mechanism that allows them to withdraw their data contribution without training from scratch. However, existing research ha…

Denoising Federated Learning

Feature Norm Regularized Federated Learning: Transforming Skewed Distributions into Global Insights

2023-12-12 · Ke Hu, Weidong Qiu, Peng Tang

In the field of federated learning, addressing non-independent and identically distributed (non-i.i.d.) data remains a quintessential challenge for improving global model performance. This work introduces the Feature Nor…

Federated Learning

FedWon: Triumphing Multi-domain Federated Learning Without Normalization

2023-06-09 · Weiming Zhuang, Lingjuan Lyu

Federated learning (FL) enhances data privacy with collaborative in-situ training on decentralized clients. Nevertheless, FL encounters challenges due to non-independent and identically distributed (non-i.i.d) data, lead…

Domain Generalization Federated Learning