Client Clustering Meets Knowledge Sharing: Enhancing Privacy and Robustness in Personalized Peer-to-Peer Learning

2025-06-25 · Mohammad Mahdi Maheri, Denys Herasymuk, Hamed Haddadi

The growing adoption of Artificial Intelligence (AI) in Internet of Things (IoT) ecosystems has intensified the need for personalized learning methods that can operate efficiently and privately across heterogeneous, resource-constrained devices. However, enabling effective personalized learning in decentralized settings introduces several challenges, including efficient knowledge transfer between clients, protection of data privacy, and resilience against poisoning attacks. In this paper, we address these challenges by developing P4 (Personalized, Private, Peer-to-Peer) -- a method designed to deliver personalized models for resource-constrained IoT devices while ensuring differential privacy and robustness against poisoning attacks. Our solution employs a lightweight, fully decentralized algorithm to privately detect client similarity and form collaborative groups. Within each group, clients leverage differentially private knowledge distillation to co-train their models, maintaining high accuracy while ensuring robustness to the presence of malicious clients. We evaluate P4 on popular benchmark datasets using both linear and CNN-based architectures across various heterogeneity settings and attack scenarios. Experimental results show that P4 achieves 5% to 30% higher accuracy than leading differentially private peer-to-peer approaches and maintains robustness with up to 30% malicious clients. Additionally, we demonstrate its practicality by deploying it on resource-constrained devices, where collaborative training between two clients adds only ~7 seconds of overhead.

📄 PDF Abstract BibTeX arXiv:2506.20413

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Distillation Transfer Learning

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Federated Learning for Short Text Clustering

2023-11-23 · Mengling Hu, Chaochao Chen, Weiming Liu, Xinting Liao 외

Short text clustering has been popularly studied for its significance in mining valuable insights from many short texts. In this paper, we focus on the federated short text clustering (FSTC) problem, i.e., clustering sho…

Clustering Federated Learning Short Text Clustering Text Clustering

Towards Federated Clustering: A Client-wise Private Graph Aggregation Framework

2025-11-14 · Guanxiong He, Jie Wang, Liaoyuan Tang, Zheng Wang 외 arxiv

Federated clustering addresses the critical challenge of extracting patterns from decentralized, unlabeled data. However, it is hampered by the flaw that current approaches are forced to accept a compromise between perfo…

Graph Clustering

Structured Federated Learning through Clustered Additive Modeling

2023-09-21 · NeurIPS 2023 11

Heterogeneous federated learning without assuming any structure is challenging due to the conflicts among non-identical data distributions of clients. In practice, clients often comprise near-homogeneous clusters so trai…

Cluster-driven Graph Federated Learning over Multiple Domains

2021-04-29 · Debora Caldarola, Massimiliano Mancini, Fabio Galasso, Marco Ciccone 외

Federated Learning (FL) deals with learning a central model (i.e. the server) in privacy-constrained scenarios, where data are stored on multiple devices (i.e. the clients). The central model has no direct access to the …

Clustering Federated Learning

Taming Cross-Domain Representation Variance in Federated Prototype Learning with Heterogeneous Data Domains

2024-03-14 · Lei Wang, Jieming Bian, Letian Zhang, Chen Chen 외

Federated learning (FL) allows collaborative machine learning training without sharing private data. While most FL methods assume identical data domains across clients, real-world scenarios often involve heterogeneous da…