One-shot Robust Federated Learning of Independent Component Analysis
This paper studies robust one-shot aggregation for distributed and federated Independent Component Analysis (ICA). In this setting, each client computes a local ICA estimator, while the server aims to recover a common global mixing matrix without accessing raw data. The main difficulty is that local ICA estimators are identifiable only up to signed permutations and may have highly heterogeneous estimation quality. We propose Spectral-Robust-Federated ICA (SRF-ICA), a one-shot aggregation method that constructs a sign-invariant affinity matrix from all local atoms, performs spectral k-means to resolve the permutation ambiguity, aligns signs within each estimated cluster, and then applies the geometric median for robust aggregation. We prove that the spectral clustering step controls the cluster-wise misclustering rate, and that the final estimator remains accurate even when a substantial fraction of local atoms are produced from low-quality clients, as long as each cluster contains a majority of reliable atoms. The analysis combines spectral perturbation bounds, k-means misclustering guarantees, and quantile-based robustness of the geometric median. Due to space constraints, simulation studies demonstrating the effectiveness of the proposed approach under heterogeneous sample sizes and corruption levels are deferred to the appendix.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Personalized Federated Dictionary Learning for Modeling Heterogeneity in Multi-site fMRI Data
Data privacy constraints pose significant challenges for large-scale neuroimaging analysis, especially in multi-site functional magnetic resonance imaging (fMRI) studies, where site-specific heterogeneity leads to non-in…
Federated LearningUTILIZING FEDERATED LEARNING AND META LEARNING FOR FEW-SHOT LEARNING ON EDGE DEVICES
The efficient and effective handling of few-shot learning tasks on mobile devices is challenging due to the small training set issue and the physical limitations in power and computational resources on these devices. In …
Federated LearningFew-Shot LearningMeta-LearningNon-IID Quantum Federated Learning with One-shot Communication Complexity
Federated learning refers to the task of machine learning based on decentralized data from multiple clients with secured data privacy. Recent studies show that quantum algorithms can be exploited to boost its performance…
Federated LearningMulti-Modal One-Shot Federated Ensemble Learning for Medical Data with Vision Large Language Model
Federated learning (FL) has attracted considerable interest in the medical domain due to its capacity to facilitate collaborative model training while maintaining data privacy. However, conventional FL methods typically …
DiagnosticEnsemble LearningFederated LearningLanguage Modeling+3GC-Fed: Gradient Centralized Federated Learning with Partial Client Participation
Federated Learning (FL) enables privacy-preserving multi-source information fusion (MSIF) but is challenged by client drift in highly heterogeneous data settings. Many existing drift-mitigation strategies rely on referen…
Federated LearningImage ClassificationPrivacy Preserving