A Communication Efficient Federated Kernel $k$-Means

2021-01-01 · Xiaochen Zhou, Xudong Wang

A federated kernel $k$-means algorithm is developed in this paper. This algorithm resolves two challenging issues: 1) how to distributedly solve the kernel $k$-means problem under federated settings; 2) how to maintain communication efficiency in the algorithm. To tackle the first challenge, a distributed stochastic proximal gradient descent (DSPGD) algorithm is developed to determine an approximated solution to the kernel $k$-means problem. To tackle the second challenge, a communication efficient mechanism (CEM) is designed to reduce the communication cost. Besides, the federated kernel $k$-means provides two levels of privacy preservation. Theoretical analysis shows: 1) DSPGD with CEM converges with an $O(1/T)$ rate, where $T$ is the number of iterations; 2) the communication cost of DSPGD with CEM is unrelated to the number of data samples; 3) the clustering loss of the federated kernel $k$-means can approach that of the centralized kernel $k$-means. The experimental results show that the federated kernel $k$-means achieves the highest clustering quality with the communication cost reduced by more than $60\%$.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Personalized Online Federated Learning with Multiple Kernels

2023-11-09 · Pouya M. Ghari, Yanning Shen

Multi-kernel learning (MKL) exhibits well-documented performance in online non-linear function approximation. Federated learning enables a group of learners (called clients) to train an MKL model on the data distributed …

Federated Learning

Communication-Avoiding Linear Algebraic Kernel K-Means on GPUs

2026-01-23 · Julian Bellavita, Matthew Rubino, Nakul Iyer, Andrew Chang 외 arxiv

Clustering is an important tool in data analysis, with K-means being popular for its simplicity and versatility. However, it cannot handle non-linearly separable clusters. Kernel K-means addresses this limitation but req…

Wireless Federated $k$-Means Clustering with Non-coherent Over-the-Air Computation

2023-08-11 · Alphan Sahin

In this study, we propose using an over-the-air computation (OAC) scheme for the federated k-means clustering algorithm to reduce the per-round communication latency when it is implemented over a wireless network. The OA…

Clustering

Federated Quantum Kernel Learning for Anomaly Detection in Multivariate IoT Time-Series

2025-11-04 · Kuan-Cheng Chen, Samuel Yen-Chi Chen, Chen-Yu Liu, Kin K. Leung arxiv

The rapid growth of industrial Internet of Things (IIoT) systems has created new challenges for anomaly detection in high-dimensional, multivariate time-series, where privacy, scalability, and communication efficiency ar…

Federated Learning Anomaly Detection

Coresets for Vertical Federated Learning: Regularized Linear Regression and $K$-Means Clustering

2022-10-26 · Lingxiao Huang, Zhize Li, Jialin Sun, Haoyu Zhao

Vertical federated learning (VFL), where data features are stored in multiple parties distributively, is an important area in machine learning. However, the communication complexity for VFL is typically very high. In thi…

Clustering Federated Learning regression Vertical Federated Learning